-- Logs begin at Thu 2022-07-28 16:46:57 UTC, end at Thu 2022-07-28 18:21:08 UTC. -- Jul 28 17:52:35.916337 dv-cinder-837543-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 17:52:35.925046 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 17:52:35 2022] *** Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: nodename: dv-cinder-837543-7-iscsi Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: machine: x86_64 Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: clock source: unix Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: pcre jit disabled Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: detected number of CPU cores: 4 Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: current working directory: / Jul 28 17:52:35.927031 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: detected binary path: /usr/bin/uwsgi-core Jul 28 17:52:35.928092 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: your processes number limit is 47680 Jul 28 17:52:35.928092 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: your memory page size is 4096 bytes Jul 28 17:52:35.928092 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: detected max file descriptor number: 2048 Jul 28 17:52:35.928092 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: lock engine: pthread robust mutexes Jul 28 17:52:35.928092 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: thunder lock: enabled Jul 28 17:52:35.928092 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 17:52:35.928092 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 17:52:35.967028 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: Python main interpreter initialized at 0x563d7fb5f9c0 Jul 28 17:52:35.967028 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: python threads support enabled Jul 28 17:52:35.967028 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: your server socket listen backlog is limited to 100 connections Jul 28 17:52:35.967028 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: your mercy for graceful operations on workers is 90 seconds Jul 28 17:52:35.967483 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 17:52:35.967483 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: *** Operational MODE: preforking *** Jul 28 17:52:35.967703 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: *** uWSGI is running in multiple interpreter mode *** Jul 28 17:52:35.967703 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: spawned uWSGI master process (pid: 115394) Jul 28 17:52:35.967906 dv-cinder-837543-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 17:52:35.969767 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: spawned uWSGI worker 1 (pid: 115395, cores: 1) Jul 28 17:52:35.969767 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: spawned uWSGI worker 2 (pid: 115396, cores: 1) Jul 28 17:52:35.970045 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 17:52:36.635068 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 17:52:36.635679 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 17:52:37.726908 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:52:37.726908 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: from cryptography.utils import int_from_bytes Jul 28 17:52:37.727633 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:52:37.727633 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: from cryptography.utils import int_from_bytes Jul 28 17:52:37.729860 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:52:37.729860 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: from cryptography.utils import int_from_bytes Jul 28 17:52:37.730271 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 17:52:37.730271 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: from cryptography.utils import int_from_bytes Jul 28 17:52:40.242892 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:52:40.243435 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:52:40.243664 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:52:40.244026 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:52:40.244284 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:52:40.244688 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.245002 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.245155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 17:52:40.245540 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.245639 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 17:52:40.245725 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.245937 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 17:52:40.246041 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.246244 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.246341 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 17:52:40.246592 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.246690 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 17:52:40.246912 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.247002 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.247239 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.247332 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.247506 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.247597 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.247817 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.247902 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.248141 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-7-iscsi {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.248232 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.248463 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.248547 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.248772 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.248855 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.249083 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.249176 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.249401 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.249491 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.249704 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.249804 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.250026 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.250116 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.250328 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.250442 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-7-iscsi {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.250685 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.250862 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.250999 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.251296 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.251422 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.251602 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.251730 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.251917 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.252035 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.252242 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.252374 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.252553 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.252678 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.252860 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.253062 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.253214 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.253399 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.253531 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.253711 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.253836 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.254027 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.254157 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.254378 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.254526 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-7-iscsi {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.254700 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.254832 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.255588 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.255755 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.255942 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.256149 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.256363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.256517 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.256647 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.256784 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.256912 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.257031 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.257197 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.257443 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-7-iscsi {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.257583 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.257774 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.257899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.258100 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.258227 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.258455 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.258593 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.258777 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.258904 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.259097 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.259231 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.259398 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.259528 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.259705 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.259842 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.260013 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.260205 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.260346 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.260469 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.260625 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.260758 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.260928 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.261053 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.261180 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.261386 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.261527 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.261684 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.261825 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.261990 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.262124 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.262300 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.262470 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.262639 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.262775 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.262904 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.263028 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.263202 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.263341 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.263521 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.263654 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.263786 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.263912 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.264083 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.264216 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.264405 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.264543 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.264709 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.264840 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.265013 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.265132 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.265278 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.265413 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.265546 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.265684 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.265842 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.265974 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.266164 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.266302 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.266504 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.266643 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.266811 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.266942 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.267117 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.267252 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.267422 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.267559 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.267727 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.267863 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.268291 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.268420 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.268602 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.268739 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.268906 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.269033 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.269222 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.269346 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.269551 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.269675 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.269840 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.269972 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.270145 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.270270 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.270472 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.270604 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.270955 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.271763 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.271982 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.272133 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.272266 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.272388 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.272532 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.272654 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.272798 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.273009 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.273147 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.273268 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.273389 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.273509 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.273652 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.273787 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.273911 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.274031 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.274157 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.274278 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.274429 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.274573 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.274696 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.274863 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.275000 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.275193 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.275320 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.275498 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.275623 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.275751 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.275872 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.276035 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.276166 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.276346 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.276484 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.276662 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.276787 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.276964 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.277090 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.277266 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.277400 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.277570 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.277703 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.277869 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.278007 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.278171 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.278302 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.278521 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.278652 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.278774 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.278906 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.279075 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.279201 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.279373 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.279505 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.279672 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.279804 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.279976 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.280107 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.280277 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.280412 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.280576 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.280708 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.280889 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.281011 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.281192 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.281325 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.281494 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.281626 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.281834 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.281966 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.282087 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.282224 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.282379 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.282520 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.282696 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.282823 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.282996 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.283119 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.283295 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.283432 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.283602 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.283724 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.283905 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.284034 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.284206 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.284348 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.284509 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.284633 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.284808 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.284931 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.285109 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.285233 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.285413 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.285530 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.285706 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.285835 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.286000 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.286124 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.286444 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.286680 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.286885 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.287084 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.287227 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.287358 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.287482 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.287633 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.287758 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.287952 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.288090 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.288254 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.288385 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.288561 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.288687 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.288864 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.288989 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.289167 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.289298 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.289464 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.289590 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.289782 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.289909 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.290087 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.290222 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.290415 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.290545 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.290722 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.290849 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.291026 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.291158 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.291344 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 17:52:40.291470 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.291680 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.291827 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.292024 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.292148 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.292301 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.292435 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.292618 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.292743 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.292948 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.293072 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.293266 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.293391 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.293582 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.293705 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.293893 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.294024 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.294199 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.294335 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.294569 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.294703 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.294846 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.294980 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.295158 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.295293 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.295465 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.295588 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.295777 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.295900 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.296093 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.296230 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.296426 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.296557 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.296741 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.296866 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.297056 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.297191 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.297372 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.297496 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.297679 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.297809 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.297986 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.298117 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.298309 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.298458 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.298645 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.298780 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.298953 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.299087 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.299270 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.299400 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.299582 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.299708 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.299890 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.300022 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.300200 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.300333 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.300509 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.300635 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.300817 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.300950 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.301123 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.301248 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.301433 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.301566 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.301750 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.301880 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.302104 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.302624 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.302943 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.303100 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.303339 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.303463 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.303640 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.303753 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.303951 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.304054 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.304263 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.304352 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.304573 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.304666 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.304881 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.304976 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.305216 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.305304 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.305533 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.305618 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.305832 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.305926 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.306140 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.306226 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.306474 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.306576 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.306809 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.306897 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.307116 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.307209 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.307430 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.307516 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.307731 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.307824 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.308034 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.308121 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.308336 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.308430 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.308645 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.308731 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.308942 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.309026 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.309271 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.309377 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.309565 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.309671 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.309863 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.309955 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.310165 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.310259 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.310505 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.310597 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.310813 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.310900 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.311120 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.311225 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.311429 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.311527 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.311732 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.311820 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.312038 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.312133 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.312348 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.312445 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.312649 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.312737 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.312970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.313058 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.313278 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.313365 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.313579 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.313662 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.313898 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.313994 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.314199 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.314286 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.314542 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.314629 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.314853 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.314940 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.315163 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.315257 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.315470 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.315557 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.315775 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.315870 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.316081 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.316166 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.316384 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.316476 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.316690 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.316776 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.316993 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.317080 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.317305 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.317400 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.318223 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.318316 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.318562 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.318657 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.318868 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.318971 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.319172 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.319292 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.319477 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.319609 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.319805 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.319908 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.320117 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.320203 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.320422 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.320515 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.320727 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.320824 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.321030 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.321125 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.321369 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.321462 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.321671 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.321758 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.321974 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.322059 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.322274 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.322379 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.322604 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.322701 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.322905 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.322993 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.323226 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.323315 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.323536 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.323630 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.323836 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.323923 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.324139 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.324238 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.324440 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.324533 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.324758 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.324843 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.325067 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.325164 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.325377 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.325470 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.325696 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.325789 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.326008 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.326106 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.326338 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.326492 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.326668 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.326761 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.326985 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.327080 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.327290 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.327375 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.327601 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.327686 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.327908 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.328006 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.328215 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.328308 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.328533 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.328620 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.328842 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.328929 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.329161 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.329246 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.329473 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.329559 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.329780 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.329873 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.330093 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.330188 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.330424 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.330527 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.330730 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.330823 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.331044 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.331130 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.331356 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.331442 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.331673 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.331760 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.331986 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.332071 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.332308 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.332404 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.332613 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.332707 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.332928 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.333020 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.333284 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.333944 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.334100 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.334188 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.334450 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.334542 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.334783 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.334887 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.335092 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.335177 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.335401 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.335485 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.335718 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.335817 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.336026 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.336111 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.336336 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.336422 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.336644 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.336738 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.336946 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.337031 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.337248 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.337339 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.337557 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.337643 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.337872 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.337958 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.338183 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.338268 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.338518 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.338608 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.338825 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.338911 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.339139 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.339226 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.339447 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.339534 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.339750 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.339899 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.340052 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.340138 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.340351 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.340444 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.340657 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.340744 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.340968 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.341061 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.341276 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.341367 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.341583 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.341677 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.341886 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.341979 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.342185 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.342276 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.342522 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.342624 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.342832 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.342926 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.343132 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.343219 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.343432 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.343518 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.343731 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.343836 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.344049 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.344141 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.344357 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.344443 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.344664 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.344757 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.344982 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.345075 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.345281 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.345366 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.345583 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.345670 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.345902 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.345990 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.346211 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.346300 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.346536 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.346639 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.346838 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.346924 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.347137 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.347223 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.347453 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.347539 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.347764 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.347850 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.348063 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.348156 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.348376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.348461 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.348687 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.348789 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.349040 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.349149 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.349351 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.349519 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.349658 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.349745 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.349966 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.350126 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.350271 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.350389 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.350604 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.350690 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.350913 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.351013 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.351220 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.351486 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.351572 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.351818 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.351913 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.352120 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.352205 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.352439 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.352523 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.352744 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.352836 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.353048 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.353135 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.353352 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.353439 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.353655 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.353749 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.353960 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.354054 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.354275 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.354394 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.354628 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.354862 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.354968 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.355191 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.355287 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.355500 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.355604 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.355819 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.355911 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.356124 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.356273 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.356426 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.356515 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.356736 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.356825 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.357039 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.357133 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.357341 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.357427 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.357643 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.357738 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.357947 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.358034 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.358264 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.358377 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.358590 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.358688 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.358898 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.358985 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.359199 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.359283 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.359500 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.359593 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.359803 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.359897 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.360105 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.360200 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.360404 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.360498 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.360704 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.360790 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.361003 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.361089 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.361307 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.361420 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.361617 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.361703 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.361917 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.362003 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.362225 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.362320 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.362552 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.362642 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.362872 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.362958 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.363180 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.363269 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.363481 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.363574 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.363783 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.363869 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.364083 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.364180 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.364452 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.364543 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.364780 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.364875 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.365091 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.365203 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.365395 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.365484 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.365702 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.365798 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.366016 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.366102 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.366327 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.366439 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.366651 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.366749 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.366962 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.367049 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.367266 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.367353 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.367568 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.367666 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.367874 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.367959 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.368177 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.368272 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.368476 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.368574 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.368785 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.368870 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.369090 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.369176 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.369392 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.369478 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.369697 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.369782 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.370024 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.370176 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.370301 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.370410 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.370643 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.370730 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.370949 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.371043 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.371253 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.371339 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.371555 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.371650 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.371859 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.371953 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.372158 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.372244 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.372462 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.372599 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.372762 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.372940 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.373077 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.373161 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.373358 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.373446 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.373668 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.373831 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.373964 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.374050 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.374263 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.374409 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.374587 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.374687 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.374896 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.374983 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.375203 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.375290 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.375505 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.375599 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.375817 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.375904 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.376122 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.376208 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.376420 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.376515 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.376721 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.376806 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.377024 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.377116 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.377322 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.377408 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.377622 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.377708 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.377920 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.378004 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.378225 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.378312 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.378552 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.378642 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.378852 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.378937 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.379161 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.379248 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.379463 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.379547 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.379762 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.379861 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.380579 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.380675 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.380906 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.380991 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.381209 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.381306 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.381506 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.381593 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.381807 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.381901 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.382107 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.382202 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.382430 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.382532 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.382751 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.382838 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.383059 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.383154 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.383360 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.383448 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.383661 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.383754 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.383961 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.384056 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.384267 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.384351 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.384579 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.384664 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.384883 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.384970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.385341 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.385456 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.385538 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.385616 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.385805 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.385894 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.386113 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.386199 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.386445 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.386584 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.386758 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.386847 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.387060 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.387147 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.387371 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.387457 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.387682 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.387769 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.387988 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.388073 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.388292 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.388386 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.388592 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.388679 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.388905 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.388990 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.389211 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.389305 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.389518 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.389603 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.389827 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.389913 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.390138 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.390241 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.390475 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.390568 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.390779 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.390877 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.391087 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.391181 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.391395 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.391488 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.391696 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.391783 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.392002 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.392089 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.392311 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.392397 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.392613 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.392704 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.392916 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.393275 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.393486 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.393581 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.393789 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.393874 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.394092 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.394178 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.394412 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.394555 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.394724 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.394870 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.395076 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.395179 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.395377 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.395464 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.396325 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.396434 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.396642 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.396741 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.396968 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.397101 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.397285 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.397381 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.397594 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.397681 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.397921 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.398015 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.398225 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.398320 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.398656 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.398734 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.398967 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.399054 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.399274 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407015 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407015 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407248 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407248 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407388 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407475 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407556 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407641 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407727 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407807 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407891 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.407983 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408064 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408064 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408206 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408283 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408361 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408451 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408537 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408537 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408681 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408766 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408845 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.408931 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409010 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409088 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409165 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409165 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409165 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409165 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409522 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409608 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409687 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409687 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409850 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.409930 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410008 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410085 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410169 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410255 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410383 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410468 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410547 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410547 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410687 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410776 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410857 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410925 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.410989 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411086 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411174 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411260 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411346 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411421 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411496 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411575 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411652 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411730 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411797 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411797 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411930 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.411998 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412063 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412128 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412192 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412278 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412365 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412444 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412522 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412606 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412691 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412778 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412858 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412858 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.412999 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413083 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413162 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413247 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413247 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413385 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413501 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413635 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413728 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413816 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413906 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.413994 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414079 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414164 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414256 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414335 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414435 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414516 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414595 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414743 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.414951 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.415063 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.415171 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.415360 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.415478 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.415664 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.415770 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.415975 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.416065 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.416279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.416366 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.416584 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.416672 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.416909 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.417011 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.417213 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.417300 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.417521 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.417616 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.417826 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.417919 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.418137 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.418232 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.418465 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.418559 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.418769 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.418868 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.419115 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.419215 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.419441 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.419530 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.419754 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.419841 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.420087 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.420189 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.420409 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.420495 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.420724 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.420810 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.421026 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.421130 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.421346 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.421433 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.421650 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.421735 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.421949 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.422043 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.422253 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.422361 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.422581 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.422678 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.422888 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.422987 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.423194 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.423283 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.423505 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.423593 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.423810 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.423902 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.424115 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.424202 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.424417 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.424508 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.424740 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.424829 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.425044 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.425142 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.425368 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.425455 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.425679 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.425776 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.425983 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.426071 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.426289 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.426451 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.426617 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.426713 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.426982 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.427081 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.427286 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.427635 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.427722 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.427944 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.428030 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.428251 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.428339 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.428565 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.428653 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.428869 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.428957 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.429172 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.429258 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.429474 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.429562 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.429796 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.429884 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.430099 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.430194 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.430445 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.430538 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.430756 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.430854 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.431057 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.431157 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.431357 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.431445 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.431659 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.431746 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.432070 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.432186 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.432304 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.432390 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.432622 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.432707 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.432936 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.433160 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.433255 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.433490 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.433577 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.433806 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.433902 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.434124 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.434211 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.434494 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.434596 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.434812 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.434907 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.435126 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.435213 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.435440 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.435526 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.435749 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.435848 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.436059 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.436144 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.436367 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.436461 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.436677 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.436773 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.436998 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.437137 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.437303 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.437404 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.437620 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.437709 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.437937 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.438152 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.438239 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.438513 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.438624 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.438833 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.438920 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.439150 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.439237 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.439464 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.439561 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.439777 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.439872 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.440089 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.440177 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.440403 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.440500 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.440715 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.440804 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.441024 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.441156 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.441331 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.441426 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.441645 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.441732 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.441956 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.442044 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.442267 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.442377 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.443127 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.443322 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.443512 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.443649 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.443969 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.444062 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.444286 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.444380 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.444601 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.444765 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.444956 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.445043 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.445271 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.445366 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.445579 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.445673 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.445893 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.445979 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.446205 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.446442 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.446590 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.446764 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.446858 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.447100 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.447236 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.447426 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.447528 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.447741 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.447894 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.448041 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.448130 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.448344 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.448432 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.448654 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.448742 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.448965 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.449050 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.449275 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.449362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.449586 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.449673 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.449897 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.449984 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.450203 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.450291 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.450542 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.450641 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.450854 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.450939 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.451160 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.451373 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.451480 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.451693 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.451787 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.452026 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.452310 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.452397 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.452658 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.452744 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.452968 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.453061 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.453283 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.453369 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.453607 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.453692 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.453910 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.454004 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.454215 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.454302 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.454553 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.454642 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.454858 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.454945 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.455159 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.455243 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.455471 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.455556 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.455777 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.455870 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.456084 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.456208 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.456389 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.456513 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.456700 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.456960 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.457229 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.457326 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.457572 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.457663 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.457884 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.457977 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.458807 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.458977 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.459291 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.459388 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.459607 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.459694 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.459919 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.460003 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.460228 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.460321 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.460540 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.460626 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.460844 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.460936 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.461153 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.461292 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.461461 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.461554 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.461765 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.461850 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.462068 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.462166 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.462388 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.462478 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.462704 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.462802 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.463006 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.463098 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.463406 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.463512 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.463615 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.463702 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.463927 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.464016 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.464232 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.464316 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.464537 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.464623 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.464843 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.464931 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.465155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.465241 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.465460 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.465553 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.465764 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.465859 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.466067 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.466154 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.466387 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.466540 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.466702 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.466790 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.467005 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.467115 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.467313 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.467456 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.467617 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.467926 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.468012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.468232 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.468325 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.468541 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.468628 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.468885 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.468979 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.469207 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.469302 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.469512 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.469606 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.469819 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.469905 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.470131 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.470223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.470463 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.470553 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.470785 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.470871 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.471094 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.471193 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.471405 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.471490 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.471717 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.471804 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.472030 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.472127 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.472343 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.472568 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.472720 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.472902 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.473000 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.473220 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.473308 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.473544 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.473630 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.473910 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.474014 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.474218 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.474305 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.474605 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.474692 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.474917 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.475083 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.475234 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.475320 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.475579 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.475678 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.475884 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.475980 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.476196 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.476284 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.476508 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.476596 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.476818 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.476913 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.477126 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.477213 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.477433 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.477577 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.477737 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.477831 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.478043 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.478130 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.478379 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.478481 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.478681 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.478769 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.478994 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.479150 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.479296 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.479395 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.479601 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.479712 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.479915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.480028 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.480252 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.480348 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.480570 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.480663 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.480884 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.480971 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.481197 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.481292 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.481512 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.481602 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.481819 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.481905 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.482124 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.482219 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.482455 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.482547 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.482765 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.482853 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.483079 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.483168 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.483406 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.483494 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.483719 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.483806 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.484022 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.484109 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.484365 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.484450 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.484672 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.484758 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.484984 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.485078 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.485303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.485398 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.485616 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.485730 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.485919 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.486007 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.486222 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.486310 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.486558 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.486683 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.486863 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.486950 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.487167 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.487253 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.487472 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.487567 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.487775 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.487863 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.488084 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.488170 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.488387 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.488475 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.488691 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.488785 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.488996 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.489089 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.489304 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.489406 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.489633 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.489726 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.489939 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.490219 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.490314 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.490461 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.490610 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.490698 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.490914 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.491000 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.491225 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.491313 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.491527 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.491612 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.491827 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.491925 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.492130 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.492225 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.492431 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.492519 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.492738 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.492834 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.493085 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.493180 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.493342 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.493428 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.493644 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.493740 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.493947 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.494035 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.494247 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.494333 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.494573 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.494675 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.494880 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.494974 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.495181 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.495268 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.495485 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.495579 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.495788 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.495887 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.496085 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.496174 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.496385 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.496473 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.496713 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.496807 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.497029 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.497139 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.497341 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.497430 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.497659 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.497744 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.497969 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.498068 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.498274 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.498381 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.498624 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.498711 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.498942 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.499041 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.499258 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.499357 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.499574 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.499669 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.499882 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.499977 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.500207 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.500293 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.500514 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.500638 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.500821 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.500916 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.501126 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.501212 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.501432 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.501526 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.501737 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.501828 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.502043 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.502138 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.502391 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.502482 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.502684 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.502825 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.502983 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.503071 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.503306 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.503400 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.503619 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.503710 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.503936 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.504032 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.504250 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.504345 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.504557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.504644 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.504884 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.504971 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.505768 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.505933 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.506056 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.506152 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.506380 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.506472 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.506695 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.506797 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.507004 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.507092 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.507316 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.507403 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.507625 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.507713 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.507868 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115395) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:52:40.507955 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.508232 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.508548 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.508877 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.509205 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.509516 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.509843 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.510181 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.510558 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.510868 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.511212 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.511542 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.511858 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.512169 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.512474 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 17:52:40.512717 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115396) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 17:52:40.664977 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO dbcounter [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Registered counter for database nova_api Jul 28 17:52:40.669850 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO dbcounter [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Registered counter for database nova_api Jul 28 17:52:40.686479 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_db.sqlalchemy.engines [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:52:40.689185 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG oslo_db.sqlalchemy.engines [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:52:40.693411 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writer thread running {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:52:40.695784 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writer thread running {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:52:40.749100 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.context [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),34fd1832-dad1-4ec6-9afc-d537dee5a553(cell1) {{(pid=115395) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 17:52:40.751516 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.context [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),34fd1832-dad1-4ec6-9afc-d537dee5a553(cell1) {{(pid=115396) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 17:52:40.753023 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:40.754670 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:40.755495 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG oslo_concurrency.lockutils [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:40.755743 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:40.757084 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG oslo_concurrency.lockutils [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:40.757853 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG oslo_concurrency.lockutils [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:52:40.757957 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:40.759850 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG oslo_concurrency.lockutils [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115396) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:52:40.759957 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO dbcounter [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Registered counter for database nova_cell0 Jul 28 17:52:40.761988 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO dbcounter [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Registered counter for database nova_cell0 Jul 28 17:52:40.765356 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO dbcounter [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Registered counter for database nova_cell1 Jul 28 17:52:40.767343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO dbcounter [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Registered counter for database nova_cell1 Jul 28 17:52:40.773822 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_db.sqlalchemy.engines [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:52:40.776011 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_db.sqlalchemy.engines [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:52:40.776981 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG oslo_db.sqlalchemy.engines [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:52:40.779123 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG oslo_db.sqlalchemy.engines [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:52:40.782649 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writer thread running {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:52:40.784125 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writer thread running {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:52:40.785500 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writer thread running {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:52:40.787708 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writer thread running {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:52:40.928439 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO dbcounter [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Registered counter for database nova_cell0 Jul 28 17:52:40.934301 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO dbcounter [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Registered counter for database nova_cell0 Jul 28 17:52:40.936038 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_db.sqlalchemy.engines [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115395) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:52:40.940619 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writer thread running {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:52:40.941154 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG oslo_db.sqlalchemy.engines [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115396) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 17:52:40.946146 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writer thread running {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 17:52:41.360215 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: WARNING keystonemiddleware.auth_token [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:52:41.368372 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: WARNING keystonemiddleware.auth_token [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:52:41.386312 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: WARNING keystonemiddleware.auth_token [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:52:41.393825 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: WARNING keystonemiddleware.auth_token [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:52:41.711059 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: WARNING keystonemiddleware.auth_token [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:52:41.717050 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: WARNING keystonemiddleware.auth_token [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:52:41.722275 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d7fb5f9c0 pid: 115395 (default app) Jul 28 17:52:41.724879 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:52:41.726043 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002263 Jul 28 17:52:41.726459 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Thu Jul 28 17:52:41 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:52:41.740148 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: WARNING keystonemiddleware.auth_token [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 17:52:41.745974 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: WARNING keystonemiddleware.auth_token [None req-4a66ab7f-3783-4add-8da2-26445e53bba8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 17:52:41.751345 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d7fb5f9c0 pid: 115396 (default app) Jul 28 17:54:02.600840 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:02.602550 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002132 Jul 28 17:54:02.603115 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:02.615634 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writing DB stats nova_api:SELECT=3 {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:02.616611 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writing DB stats nova_cell1:SELECT=3 {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:02.617555 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writing DB stats nova_cell0:SELECT=3 {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:02.618954 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:03.511117 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-99e08745-85fe-4d76-b0da-a252cbe6150d admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:03.544490 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-99e08745-85fe-4d76-b0da-a252cbe6150d admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.934556 Jul 28 17:54:03.546517 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1291 bytes} [Thu Jul 28 17:54:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:05.856645 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:05.857791 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-3f54c980-f27a-4ee4-a6b7-90597d7e44b5 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jul 28 17:54:05.858960 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 3/4] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:06.373144 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-694b70bf-849f-46b5-a52f-173bc4a2ab3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "disk": 1, "ram": 256, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:06.395657 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:54:06.395657 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: warnings.warn(msg) Jul 28 17:54:06.505788 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-694b70bf-849f-46b5-a52f-173bc4a2ab3e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.639608 Jul 28 17:54:06.506578 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 2/5] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:54:06.726985 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-c1b05fa4-72b8-4dc2-812a-e74c08b621f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:06.731321 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:54:06.731321 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: warnings.warn(msg) Jul 28 17:54:06.752325 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_api:SELECT=3 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:06.754226 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_cell0:SELECT=3 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:06.755090 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_cell1:SELECT=3 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:06.756015 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:06.853843 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-c1b05fa4-72b8-4dc2-812a-e74c08b621f6 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.338531 Jul 28 17:54:06.863209 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 4/6] 10.222.0.85 () {64 vars in 1335 bytes} [Thu Jul 28 17:54:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:09.119145 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-694b70bf-849f-46b5-a52f-173bc4a2ab3e admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:09.120111 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-694b70bf-849f-46b5-a52f-173bc4a2ab3e admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Jul 28 17:54:09.120724 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 3/7] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:09.792480 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-accafe83-f93a-4ca4-8ad7-1566a5a92af5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:09.812237 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:54:09.812237 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: warnings.warn(msg) Jul 28 17:54:09.940463 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-accafe83-f93a-4ca4-8ad7-1566a5a92af5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.813256 Jul 28 17:54:09.941137 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 5/8] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:54:09.953948 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-d33f4bb7-400f-4d8e-b989-7f102da9fa26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:09.957376 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:54:09.957376 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: warnings.warn(msg) Jul 28 17:54:10.075847 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-d33f4bb7-400f-4d8e-b989-7f102da9fa26 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125658 Jul 28 17:54:10.076499 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 4/9] 10.222.0.85 () {64 vars in 1335 bytes} [Thu Jul 28 17:54:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:12.336161 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-accafe83-f93a-4ca4-8ad7-1566a5a92af5 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:12.337146 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-accafe83-f93a-4ca4-8ad7-1566a5a92af5 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 28 17:54:12.337691 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:12.792564 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-e15bc33f-a730-43ed-93dc-244ef41b29f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "ram": 1024, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:12.894870 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-e15bc33f-a730-43ed-93dc-244ef41b29f6 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.550937 Jul 28 17:54:12.895305 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 5/11] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:54:12.908222 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-5fe6f02f-eef3-4942-84a1-8e9ffb01ba21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:12.994820 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-5fe6f02f-eef3-4942-84a1-8e9ffb01ba21 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090978 Jul 28 17:54:12.995421 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 7/12] 10.222.0.85 () {64 vars in 1335 bytes} [Thu Jul 28 17:54:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:15.314467 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-e15bc33f-a730-43ed-93dc-244ef41b29f6 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:15.315511 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-e15bc33f-a730-43ed-93dc-244ef41b29f6 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Jul 28 17:54:15.315912 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 6/13] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:15.757165 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-6d9d9949-a337-4cef-9870-8b2bb9896a17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:15.831098 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-6d9d9949-a337-4cef-9870-8b2bb9896a17 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509083 Jul 28 17:54:15.831753 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 8/14] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:54:15.843702 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-456d38c7-c616-4ed1-b8b7-c3a9d71d4ac6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:15.921250 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-456d38c7-c616-4ed1-b8b7-c3a9d71d4ac6 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080969 Jul 28 17:54:15.921834 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 7/15] 10.222.0.85 () {64 vars in 1335 bytes} [Thu Jul 28 17:54:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:18.147630 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-6d9d9949-a337-4cef-9870-8b2bb9896a17 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:18.148636 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-6d9d9949-a337-4cef-9870-8b2bb9896a17 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jul 28 17:54:18.149038 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 9/16] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:18.577357 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-da322bae-b0cb-4a97-95e3-4ac865ac7212 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:18.687940 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-da322bae-b0cb-4a97-95e3-4ac865ac7212 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.532941 Jul 28 17:54:18.688489 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 8/17] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:54:18.700674 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-13ff3171-a132-4e52-bacd-06356cd4a78d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:19.098364 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-13ff3171-a132-4e52-bacd-06356cd4a78d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.401144 Jul 28 17:54:19.099266 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 10/18] 10.222.0.85 () {64 vars in 1335 bytes} [Thu Jul 28 17:54:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:54:21.298989 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-da322bae-b0cb-4a97-95e3-4ac865ac7212 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:21.300015 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-da322bae-b0cb-4a97-95e3-4ac865ac7212 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jul 28 17:54:21.300412 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 9/19] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:21.721520 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-fd1bb940-03b4-48f1-8da5-ef6d2810dfae admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:21.746020 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-fd1bb940-03b4-48f1-8da5-ef6d2810dfae admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.439538 Jul 28 17:54:21.746538 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 11/20] 10.222.0.85 () {60 vars in 1291 bytes} [Thu Jul 28 17:54:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:54:24.027337 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-da322bae-b0cb-4a97-95e3-4ac865ac7212 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:24.028705 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-da322bae-b0cb-4a97-95e3-4ac865ac7212 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001956 Jul 28 17:54:24.029288 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 10/21] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:24.476623 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-40b72353-2961-48a8-b3a0-8be6556da90a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "disk": 1, "name": "m1.tiny", "ram": 512, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:24.557363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-40b72353-2961-48a8-b3a0-8be6556da90a admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.521410 Jul 28 17:54:24.557929 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 12/22] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:54:24.571647 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-88a7f936-ffe8-44b9-8b23-289bf21790bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:24.671029 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-88a7f936-ffe8-44b9-8b23-289bf21790bd admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104311 Jul 28 17:54:24.677490 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 11/23] 10.222.0.85 () {64 vars in 1332 bytes} [Thu Jul 28 17:54:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:26.905619 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-40b72353-2961-48a8-b3a0-8be6556da90a admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:26.906834 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-40b72353-2961-48a8-b3a0-8be6556da90a admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jul 28 17:54:26.907487 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:27.431470 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-526ae254-431d-4158-9128-678f5a61c46e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "2", "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:27.510454 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-526ae254-431d-4158-9128-678f5a61c46e admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.596786 Jul 28 17:54:27.511211 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 12/25] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:54:27.523944 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-e8c17131-de95-40c3-a7b3-74606c95299c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:27.605410 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-e8c17131-de95-40c3-a7b3-74606c95299c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085129 Jul 28 17:54:27.606175 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 14/26] 10.222.0.85 () {64 vars in 1332 bytes} [Thu Jul 28 17:54:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:29.851439 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-526ae254-431d-4158-9128-678f5a61c46e admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:29.852482 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-526ae254-431d-4158-9128-678f5a61c46e admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 28 17:54:29.852884 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 13/27] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:30.233923 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-e739179d-cbd2-4f86-84a1-176f1deaf3a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:30.361708 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-e739179d-cbd2-4f86-84a1-176f1deaf3a9 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.502865 Jul 28 17:54:30.362263 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 15/28] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:54:30.374117 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-688ca025-d3b7-4239-a338-2eb3e9293eae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:30.479881 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-688ca025-d3b7-4239-a338-2eb3e9293eae admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109355 Jul 28 17:54:30.480403 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 14/29] 10.222.0.85 () {64 vars in 1332 bytes} [Thu Jul 28 17:54:30 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:32.836605 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-e739179d-cbd2-4f86-84a1-176f1deaf3a9 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:32.837527 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-e739179d-cbd2-4f86-84a1-176f1deaf3a9 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 28 17:54:32.837987 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 16/30] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:33.315791 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-d5767253-8537-4adf-aed0-2b1404e86841 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192, "swap": 0}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:33.321570 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:33.430685 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-d5767253-8537-4adf-aed0-2b1404e86841 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.586025 Jul 28 17:54:33.444332 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-49c4854c-a227-4a1f-892d-1f1fb2085734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:33.449829 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 15/31] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:54:33.559939 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-49c4854c-a227-4a1f-892d-1f1fb2085734 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120062 Jul 28 17:54:33.564040 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 17/32] 10.222.0.85 () {64 vars in 1332 bytes} [Thu Jul 28 17:54:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 17:54:35.833519 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-d5767253-8537-4adf-aed0-2b1404e86841 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:35.835234 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-d5767253-8537-4adf-aed0-2b1404e86841 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002151 Jul 28 17:54:35.835899 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 16/33] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:54:36.427600 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-054ef5e6-a9d3-4c78-919e-4f5ec30cdaa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:36.505163 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-054ef5e6-a9d3-4c78-919e-4f5ec30cdaa7 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.662975 Jul 28 17:54:36.506457 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 18/34] 10.222.0.85 () {64 vars in 1282 bytes} [Thu Jul 28 17:54:35 2022] POST /compute/v2.1/flavors => generated 408 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:54:36.520469 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-045fe3e4-dd4c-4252-8e11-1c2b865bd8bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:54:36.697487 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-045fe3e4-dd4c-4252-8e11-1c2b865bd8bd admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.182823 Jul 28 17:54:36.697996 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 17/35] 10.222.0.85 () {64 vars in 1332 bytes} [Thu Jul 28 17:54:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:54:57.500746 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-054ef5e6-a9d3-4c78-919e-4f5ec30cdaa7 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:57.501781 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-054ef5e6-a9d3-4c78-919e-4f5ec30cdaa7 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Jul 28 17:54:57.502191 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 19/36] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:54:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:57.919189 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-8bcdf263-2fb9-4462-919b-41635279f8c3 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:57.938062 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-8bcdf263-2fb9-4462-919b-41635279f8c3 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.429367 Jul 28 17:54:57.938557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 18/37] 10.222.0.85 () {60 vars in 1291 bytes} [Thu Jul 28 17:54:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:54:59.035552 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-054ef5e6-a9d3-4c78-919e-4f5ec30cdaa7 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:59.036561 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-054ef5e6-a9d3-4c78-919e-4f5ec30cdaa7 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 28 17:54:59.036962 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 20/38] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:54:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:54:59.576758 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-bc8ffeb8-6572-4011-8715-b7393ad667f2 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:59.582856 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.wsgi [None req-bc8ffeb8-6572-4011-8715-b7393ad667f2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-bc8ffeb8-6572-4011-8715-b7393ad667f2 admin admin] Request method failure captured: Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Accept: application/json Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Accept-Encoding: gzip, deflate Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Connection: keep-alive Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Content-Length: 0 Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Host: 10.222.0.85 Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Openstack-Api-Version: compute 2.90 Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Openstack-System-Scope: None Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: User-Agent: python-novaclient Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Auth-Token: gAAAAABi4s1ycPdQ7vOWZvg4ouV_aCYmCuDtIl2BHw-8MyFMzIp_B9Afb4lNQl9jPFSPdjKczVgQ4LUCziq7M25U02LNd_Pz_484TG6RBGIbdm1e2LUCDjQjoesxB4Y_ZgfLPFCXd7yliLzbWk9KX1YW7-WzkW8yCgczhaok1wRLEbx0o8zoKR4 Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Domain-Id: None Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Domain-Name: None Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Identity-Status: Confirmed Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Is-Admin-Project: True Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Domain-Id: default Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Domain-Name: Default Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Name: admin Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Role: admin,reader,member Jul 28 17:54:59.586074 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Roles: admin,reader,member Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_eaffcb498d9c405ca0d18c97b43881f2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant: admin Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant-Name: admin Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User: admin Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Domain-Id: default Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Domain-Name: Default Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Id: 5580a3ecfd9d47fb8a889209b62e0089 Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Name: admin Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: method: > Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: exception: Flavor 42 could not be found. Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: action_args: {'id': '42'} Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:54:59.587978 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:54:59.589155 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.590557 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-bc8ffeb8-6572-4011-8715-b7393ad667f2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:54:59.592185 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-bc8ffeb8-6572-4011-8715-b7393ad667f2 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.411425 Jul 28 17:54:59.592185 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1190 bytes} [Thu Jul 28 17:54:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:54:59.597413 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-9afbb920-e53a-4830-a46a-86b31b2e1f14 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:59.605112 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:54:59.620960 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-9afbb920-e53a-4830-a46a-86b31b2e1f14 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027183 Jul 28 17:54:59.621514 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1210 bytes} [Thu Jul 28 17:54:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:54:59.632343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-79188e54-bd04-4c72-bc2a-bc3a7616d2d2 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:59.657192 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-79188e54-bd04-4c72-bc2a-bc3a7616d2d2 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028402 Jul 28 17:54:59.657738 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 20/41] 10.222.0.85 () {60 vars in 1210 bytes} [Thu Jul 28 17:54:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:54:59.667672 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-9ffea793-e60b-4a33-ba2f-89048a439e5b admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:54:59.674264 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.wsgi [None req-9ffea793-e60b-4a33-ba2f-89048a439e5b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-9ffea793-e60b-4a33-ba2f-89048a439e5b admin admin] Request method failure captured: Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Accept: application/json Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Accept-Encoding: gzip, deflate Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Connection: keep-alive Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Content-Length: 0 Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Host: 10.222.0.85 Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Openstack-Api-Version: compute 2.90 Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Openstack-System-Scope: None Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: User-Agent: python-novaclient Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Auth-Token: gAAAAABi4s1ycPdQ7vOWZvg4ouV_aCYmCuDtIl2BHw-8MyFMzIp_B9Afb4lNQl9jPFSPdjKczVgQ4LUCziq7M25U02LNd_Pz_484TG6RBGIbdm1e2LUCDjQjoesxB4Y_ZgfLPFCXd7yliLzbWk9KX1YW7-WzkW8yCgczhaok1wRLEbx0o8zoKR4 Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Domain-Id: None Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Domain-Name: None Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Identity-Status: Confirmed Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Is-Admin-Project: True Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Domain-Id: default Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Domain-Name: Default Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Name: admin Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Role: admin,reader,member Jul 28 17:54:59.677508 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Roles: admin,reader,member Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_eaffcb498d9c405ca0d18c97b43881f2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant: admin Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant-Name: admin Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User: admin Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Domain-Id: default Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Domain-Name: Default Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Id: 5580a3ecfd9d47fb8a889209b62e0089 Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Name: admin Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: method: > Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: exception: Flavor 42 could not be found. Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: action_args: {'id': '42'} Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:54:59.679082 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:54:59.680031 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:54:59.681303 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-9ffea793-e60b-4a33-ba2f-89048a439e5b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:54:59.682569 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-9ffea793-e60b-4a33-ba2f-89048a439e5b admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015036 Jul 28 17:54:59.682783 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 22/42] 10.222.0.85 () {60 vars in 1190 bytes} [Thu Jul 28 17:54:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:00.665386 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-79188e54-bd04-4c72-bc2a-bc3a7616d2d2 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:00.666440 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-79188e54-bd04-4c72-bc2a-bc3a7616d2d2 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jul 28 17:55:00.666849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 21/43] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:55:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:01.207852 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-d382ea35-f89f-4df4-9273-603263dc5b13 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:01.213281 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.wsgi [None req-d382ea35-f89f-4df4-9273-603263dc5b13 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-d382ea35-f89f-4df4-9273-603263dc5b13 admin admin] Request method failure captured: Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Accept: application/json Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Accept-Encoding: gzip, deflate Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Connection: keep-alive Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Content-Length: 0 Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Host: 10.222.0.85 Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Openstack-Api-Version: compute 2.90 Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Openstack-System-Scope: None Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: User-Agent: python-novaclient Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Auth-Token: gAAAAABi4s1051XIgH6BwIEy7apcoVhDz7b7t0YdiFIBQXz08oPsCg0XngKL1mpBsgaHdHGmrb-pzBtQaH63JByREY9rAu7CE8JYXegvdaEKfdAUnmQrMKwzHkbutp1wUdaXQm1baU-_HqpEdKy3EtN_ZFAOTQiSqT-Czv-7mBRweZvTiMDtrPk Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Domain-Id: None Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Domain-Name: None Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Identity-Status: Confirmed Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Is-Admin-Project: True Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Domain-Id: default Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Domain-Name: Default Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Name: admin Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Role: admin,reader,member Jul 28 17:55:01.214899 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Roles: admin,reader,member Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_eaffcb498d9c405ca0d18c97b43881f2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant: admin Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant-Name: admin Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User: admin Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Domain-Id: default Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Domain-Name: Default Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Id: 5580a3ecfd9d47fb8a889209b62e0089 Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Name: admin Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: method: > Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: exception: Flavor 84 could not be found. Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: action_args: {'id': '84'} Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:55:01.216217 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:55:01.217012 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.218376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-d382ea35-f89f-4df4-9273-603263dc5b13 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:55:01.219673 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-d382ea35-f89f-4df4-9273-603263dc5b13 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.409688 Jul 28 17:55:01.219673 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 23/44] 10.222.0.85 () {60 vars in 1190 bytes} [Thu Jul 28 17:55:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:01.226266 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-8f35b32e-67d9-4dfe-914b-6658a63fef41 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:01.241511 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-8f35b32e-67d9-4dfe-914b-6658a63fef41 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018906 Jul 28 17:55:01.242055 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 22/45] 10.222.0.85 () {60 vars in 1210 bytes} [Thu Jul 28 17:55:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:55:01.252139 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-70f86134-43a0-45ff-b1f8-a589bae5fc5f admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:01.269675 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-70f86134-43a0-45ff-b1f8-a589bae5fc5f admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021284 Jul 28 17:55:01.270249 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1210 bytes} [Thu Jul 28 17:55:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:55:01.279736 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-0389625d-4c4c-4022-9692-8ce4583559d6 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:01.285324 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.wsgi [None req-0389625d-4c4c-4022-9692-8ce4583559d6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-0389625d-4c4c-4022-9692-8ce4583559d6 admin admin] Request method failure captured: Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Accept: application/json Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Accept-Encoding: gzip, deflate Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Connection: keep-alive Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Content-Length: 0 Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Host: 10.222.0.85 Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Openstack-Api-Version: compute 2.90 Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Openstack-System-Scope: None Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: User-Agent: python-novaclient Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Auth-Token: gAAAAABi4s1051XIgH6BwIEy7apcoVhDz7b7t0YdiFIBQXz08oPsCg0XngKL1mpBsgaHdHGmrb-pzBtQaH63JByREY9rAu7CE8JYXegvdaEKfdAUnmQrMKwzHkbutp1wUdaXQm1baU-_HqpEdKy3EtN_ZFAOTQiSqT-Czv-7mBRweZvTiMDtrPk Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Domain-Id: None Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Domain-Name: None Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Identity-Status: Confirmed Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Is-Admin-Project: True Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Domain-Id: default Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Domain-Name: Default Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Name: admin Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Role: admin,reader,member Jul 28 17:55:01.286849 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Roles: admin,reader,member Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_eaffcb498d9c405ca0d18c97b43881f2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant: admin Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant-Name: admin Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User: admin Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Domain-Id: default Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Domain-Name: Default Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Id: 5580a3ecfd9d47fb8a889209b62e0089 Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Name: admin Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: method: > Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: exception: Flavor 84 could not be found. Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: action_args: {'id': '84'} Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:55:01.288362 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:55:01.289214 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:01.290279 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-0389625d-4c4c-4022-9692-8ce4583559d6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:55:01.291348 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-0389625d-4c4c-4022-9692-8ce4583559d6 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012085 Jul 28 17:55:01.291348 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 23/47] 10.222.0.85 () {60 vars in 1190 bytes} [Thu Jul 28 17:55:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:02.264905 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-70f86134-43a0-45ff-b1f8-a589bae5fc5f admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:02.265960 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-70f86134-43a0-45ff-b1f8-a589bae5fc5f admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 28 17:55:02.266376 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 25/48] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:55:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:02.808246 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-7baaa72f-cb6f-409c-9254-39d5aa912bc5 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:02.814851 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.wsgi [None req-7baaa72f-cb6f-409c-9254-39d5aa912bc5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-7baaa72f-cb6f-409c-9254-39d5aa912bc5 admin admin] Request method failure captured: Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Accept: application/json Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Accept-Encoding: gzip, deflate Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Connection: keep-alive Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Content-Length: 0 Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Host: 10.222.0.85 Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Openstack-Api-Version: compute 2.90 Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Openstack-System-Scope: None Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: User-Agent: python-novaclient Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Auth-Token: gAAAAABi4s12xd5A6L5BSmyX9kHtVesiNHRXR4WhXRKahrcNSqGoNEl3clUi3sScUyEgsKLDyPT0Cxo3iiqrgCRx-PLFrbUe9gjqnfiRghpcvupYFhAxdi3YKzqTA5jCMT83sv_x8tv4hZc2jrZKbPt_EFLWlrd4QV1ccMjHEfn03ce3XCAfIS4 Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Domain-Id: None Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Domain-Name: None Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Identity-Status: Confirmed Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Is-Admin-Project: True Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Domain-Id: default Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Domain-Name: Default Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Project-Name: admin Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Role: admin,reader,member Jul 28 17:55:02.816343 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Roles: admin,reader,member Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_eaffcb498d9c405ca0d18c97b43881f2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant: admin Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-Tenant-Name: admin Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User: admin Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Domain-Id: default Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Domain-Name: Default Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Id: 5580a3ecfd9d47fb8a889209b62e0089 Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: X-User-Name: admin Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: method: > Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: exception: Flavor 451 could not be found. Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: action_args: {'id': '451'} Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:55:02.817970 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:55:02.818915 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.820223 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-7baaa72f-cb6f-409c-9254-39d5aa912bc5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115396) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:55:02.821584 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-7baaa72f-cb6f-409c-9254-39d5aa912bc5 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.412854 Jul 28 17:55:02.821584 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1193 bytes} [Thu Jul 28 17:55:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:02.828553 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-0f4d5053-d758-4cf5-8592-8e025f542454 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:02.843896 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-0f4d5053-d758-4cf5-8592-8e025f542454 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019498 Jul 28 17:55:02.844457 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 26/50] 10.222.0.85 () {60 vars in 1210 bytes} [Thu Jul 28 17:55:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:55:02.854230 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:02.869470 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018821 Jul 28 17:55:02.870015 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 25/51] 10.222.0.85 () {60 vars in 1210 bytes} [Thu Jul 28 17:55:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:55:02.880010 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-32145025-784e-4806-86c0-1b854a33a432 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:02.885652 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.wsgi [None req-32145025-784e-4806-86c0-1b854a33a432 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-32145025-784e-4806-86c0-1b854a33a432 admin admin] Request method failure captured: Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Accept: application/json Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Accept-Encoding: gzip, deflate Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Connection: keep-alive Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Content-Length: 0 Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Host: 10.222.0.85 Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Openstack-Api-Version: compute 2.90 Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Openstack-System-Scope: None Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: User-Agent: python-novaclient Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Auth-Token: gAAAAABi4s12xd5A6L5BSmyX9kHtVesiNHRXR4WhXRKahrcNSqGoNEl3clUi3sScUyEgsKLDyPT0Cxo3iiqrgCRx-PLFrbUe9gjqnfiRghpcvupYFhAxdi3YKzqTA5jCMT83sv_x8tv4hZc2jrZKbPt_EFLWlrd4QV1ccMjHEfn03ce3XCAfIS4 Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Domain-Id: None Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Domain-Name: None Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Identity-Status: Confirmed Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Is-Admin-Project: True Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Domain-Id: default Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Domain-Name: Default Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Project-Name: admin Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Role: admin,reader,member Jul 28 17:55:02.887181 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Roles: admin,reader,member Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_eaffcb498d9c405ca0d18c97b43881f2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/eaffcb498d9c405ca0d18c97b43881f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant: admin Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant-Id: eaffcb498d9c405ca0d18c97b43881f2 Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-Tenant-Name: admin Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User: admin Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Domain-Id: default Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Domain-Name: Default Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Id: 5580a3ecfd9d47fb8a889209b62e0089 Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: X-User-Name: admin Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: method: > Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: exception: Flavor 451 could not be found. Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: action_args: {'id': '451'} Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 17:55:02.888992 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:55:02.899363 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: ERROR nova.api.openstack.wsgi Jul 28 17:55:02.900603 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-32145025-784e-4806-86c0-1b854a33a432 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115395) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 17:55:02.901650 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-32145025-784e-4806-86c0-1b854a33a432 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012331 Jul 28 17:55:02.901650 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 27/52] 10.222.0.85 () {60 vars in 1193 bytes} [Thu Jul 28 17:55:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 17:55:03.875312 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:03.876353 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 28 17:55:03.876783 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:55:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:04.422637 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-1aa10fd6-fada-4db7-9686-7f220de5b71c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:04.526845 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-1aa10fd6-fada-4db7-9686-7f220de5b71c admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.510020 Jul 28 17:55:04.527432 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 28/54] 10.222.0.85 () {64 vars in 1235 bytes} [Thu Jul 28 17:55:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 17:55:05.519747 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:05.520765 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 28 17:55:05.521166 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 27/55] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:55:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 17:55:06.077811 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-1cc64495-3c6a-492e-8969-dda440d4998f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:06.189389 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-1cc64495-3c6a-492e-8969-dda440d4998f admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.527642 Jul 28 17:55:06.189942 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 29/56] 10.222.0.85 () {64 vars in 1235 bytes} [Thu Jul 28 17:55:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:55:07.208625 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:07.209639 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 28 17:55:07.210051 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 28/57] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:55:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:07.769579 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-52c76f41-7463-4154-b7d5-e05f377fde09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:07.881799 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-52c76f41-7463-4154-b7d5-e05f377fde09 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.531054 Jul 28 17:55:07.882271 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 30/58] 10.222.0.85 () {64 vars in 1235 bytes} [Thu Jul 28 17:55:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:55:08.879243 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:08.880251 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 28 17:55:08.880651 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 29/59] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:55:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:09.419669 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-d0e21369-203c-4cba-b46b-3216a1fc0e0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 17:55:09.503263 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-d0e21369-203c-4cba-b46b-3216a1fc0e0b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.482525 Jul 28 17:55:09.503829 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 31/60] 10.222.0.85 () {64 vars in 1235 bytes} [Thu Jul 28 17:55:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:55:10.489339 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:10.490419 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jul 28 17:55:10.490814 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 30/61] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:55:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:55:11.030669 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-83a63f50-534d-4d7c-94d3-62acfd88cf79 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:55:11.051216 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-83a63f50-534d-4d7c-94d3-62acfd88cf79 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.418070 Jul 28 17:55:11.051758 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 32/62] 10.222.0.85 () {60 vars in 1202 bytes} [Thu Jul 28 17:55:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 17:56:03.645633 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:03.646808 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-6b48ead7-3388-4ab3-b172-843bcfde0b72 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Jul 28 17:56:03.653645 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 31/63] 10.222.0.85 () {54 vars in 930 bytes} [Thu Jul 28 17:56:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:56:03.659187 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:04.066306 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-5f18f3b3-4caf-43e4-8c7a-3b28f3ed6552 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:04.087386 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-5f18f3b3-4caf-43e4-8c7a-3b28f3ed6552 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.432818 Jul 28 17:56:04.087936 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 33/64] 10.222.0.85 () {60 vars in 1291 bytes} [Thu Jul 28 17:56:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 17:56:04.108806 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG dbcounter [-] [115396] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=115396) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:56:04.112552 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-bb4138a3-af9b-486b-8cf4-ccb9dbea9a76 admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:04.120235 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-bb4138a3-af9b-486b-8cf4-ccb9dbea9a76 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012755 Jul 28 17:56:04.120752 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 32/65] 10.222.0.85 () {60 vars in 1282 bytes} [Thu Jul 28 17:56:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:04.133848 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-331ec594-d277-40c2-b4b2-9fd2211363a1 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:04.142744 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-331ec594-d277-40c2-b4b2-9fd2211363a1 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012498 Jul 28 17:56:04.143272 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 34/66] 10.222.0.85 () {60 vars in 1285 bytes} [Thu Jul 28 17:56:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:04.155189 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:04.162972 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011823 Jul 28 17:56:04.163487 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 33/67] 10.222.0.85 () {60 vars in 1285 bytes} [Thu Jul 28 17:56:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:56:04.175078 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-472fd0cb-1b07-4300-b2eb-5ec9143fc13b admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:56:04.182804 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-472fd0cb-1b07-4300-b2eb-5ec9143fc13b admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011179 Jul 28 17:56:04.183821 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1282 bytes} [Thu Jul 28 17:56:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 17:59:50.123073 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:50.124112 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jul 28 17:59:50.124523 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 34/69] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:59:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:59:50.269005 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_api:SELECT=6 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 17:59:50.426534 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-3876a1db-08fd-4210-a5f8-8c646df353f7 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:50.429039 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:59:50.429039 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: warnings.warn(msg) Jul 28 17:59:50.430259 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-3876a1db-08fd-4210-a5f8-8c646df353f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:50.430737 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-3876a1db-08fd-4210-a5f8-8c646df353f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:50.431531 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-3876a1db-08fd-4210-a5f8-8c646df353f7 admin admin] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:50.432041 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-3876a1db-08fd-4210-a5f8-8c646df353f7 admin admin] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:50.467287 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-3876a1db-08fd-4210-a5f8-8c646df353f7 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200433 Jul 28 17:59:50.467882 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 36/70] 10.222.0.85 () {60 vars in 1193 bytes} [Thu Jul 28 17:59:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 17:59:51.321883 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:51.322924 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 28 17:59:51.323324 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 17:59:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 17:59:51.519971 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-f85c0bbb-6f66-406a-ab76-7db51d753ee9 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 17:59:51.522386 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 17:59:51.522386 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: warnings.warn(msg) Jul 28 17:59:51.523591 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-f85c0bbb-6f66-406a-ab76-7db51d753ee9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:51.524030 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-f85c0bbb-6f66-406a-ab76-7db51d753ee9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:51.524814 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-f85c0bbb-6f66-406a-ab76-7db51d753ee9 admin admin] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 17:59:51.525287 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-f85c0bbb-6f66-406a-ab76-7db51d753ee9 admin admin] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 17:59:51.545243 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-f85c0bbb-6f66-406a-ab76-7db51d753ee9 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080360 Jul 28 17:59:51.545828 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 37/72] 10.222.0.85 () {60 vars in 1193 bytes} [Thu Jul 28 17:59:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:00:02.851591 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:00:02.852604 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 28 18:00:02.853010 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 36/73] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 18:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:00:02.998003 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_cell0:SELECT=4 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:02.998735 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_cell1:SELECT=4 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:02.999364 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG dbcounter [-] [115395] Writing DB stats nova_api:SELECT=8 {{(pid=115395) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:00:03.049244 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-7bc02a1a-68ca-4c72-b574-e063e070e539 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:00:03.051942 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:03.051942 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: warnings.warn(msg) Jul 28 18:00:03.053067 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-7bc02a1a-68ca-4c72-b574-e063e070e539 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:00:03.053505 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-7bc02a1a-68ca-4c72-b574-e063e070e539 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:00:03.054284 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-7bc02a1a-68ca-4c72-b574-e063e070e539 admin admin] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:00:03.054786 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-7bc02a1a-68ca-4c72-b574-e063e070e539 admin admin] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:00:03.081699 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-7bc02a1a-68ca-4c72-b574-e063e070e539 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088047 Jul 28 18:00:03.082277 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 38/74] 10.222.0.85 () {60 vars in 1193 bytes} [Thu Jul 28 18:00:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:00:03.929838 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: DEBUG nova.api.openstack.wsgi [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] Calling method '>' {{(pid=115396) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:00:03.930911 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: INFO nova.api.openstack.requestlog [None req-b9fec7e0-84aa-40d5-90e6-21291037fe6c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 28 18:00:03.931317 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: [pid: 115396|app: 0|req: 37/75] 10.222.0.85 () {56 vars in 1074 bytes} [Thu Jul 28 18:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:00:04.127329 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG nova.api.openstack.wsgi [None req-6e5fcde4-f824-47cd-b841-17f37be81354 admin admin] Calling method '>' {{(pid=115395) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:00:04.129693 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 18:00:04.129693 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: warnings.warn(msg) Jul 28 18:00:04.130943 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-6e5fcde4-f824-47cd-b841-17f37be81354 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:00:04.131383 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-6e5fcde4-f824-47cd-b841-17f37be81354 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:00:04.132161 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-6e5fcde4-f824-47cd-b841-17f37be81354 admin admin] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:00:04.132587 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: DEBUG oslo_concurrency.lockutils [None req-6e5fcde4-f824-47cd-b841-17f37be81354 admin admin] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115395) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:00:04.155123 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: INFO nova.api.openstack.requestlog [None req-6e5fcde4-f824-47cd-b841-17f37be81354 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081277 Jul 28 18:00:04.155635 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: [pid: 115395|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1193 bytes} [Thu Jul 28 18:00:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:00:59.670813 dv-cinder-837543-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 18:00:59.671371 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: Thu Jul 28 18:00:59 2022 - graceful shutdown triggered... Jul 28 18:00:59.671809 dv-cinder-837543-7-iscsi devstack@n-api.service[115395]: Gracefully killing worker 1 (pid: 115395)... Jul 28 18:00:59.672167 dv-cinder-837543-7-iscsi devstack@n-api.service[115396]: Gracefully killing worker 2 (pid: 115396)... Jul 28 18:01:00.671728 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: worker 1 buried after 1 seconds Jul 28 18:01:00.671728 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: worker 2 buried after 1 seconds Jul 28 18:01:00.672460 dv-cinder-837543-7-iscsi devstack@n-api.service[115394]: goodbye to uWSGI. Jul 28 18:01:00.673323 dv-cinder-837543-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 18:01:00.674124 dv-cinder-837543-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 18:01:00.677327 dv-cinder-837543-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 18:01:00.687323 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 18:01:00 2022] *** Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: nodename: dv-cinder-837543-7-iscsi Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: machine: x86_64 Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: clock source: unix Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: pcre jit disabled Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: detected number of CPU cores: 4 Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: current working directory: / Jul 28 18:01:00.689440 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: detected binary path: /usr/bin/uwsgi-core Jul 28 18:01:00.690208 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: your processes number limit is 47680 Jul 28 18:01:00.690208 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: your memory page size is 4096 bytes Jul 28 18:01:00.690208 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: detected max file descriptor number: 2048 Jul 28 18:01:00.690208 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: lock engine: pthread robust mutexes Jul 28 18:01:00.690208 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: thunder lock: enabled Jul 28 18:01:00.690208 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 18:01:00.690208 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 18:01:00.733068 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: Python main interpreter initialized at 0x55a7ab1fb9c0 Jul 28 18:01:00.733068 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: python threads support enabled Jul 28 18:01:00.733068 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: your server socket listen backlog is limited to 100 connections Jul 28 18:01:00.733068 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: your mercy for graceful operations on workers is 90 seconds Jul 28 18:01:00.733527 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 18:01:00.733527 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: *** Operational MODE: preforking *** Jul 28 18:01:00.733685 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: *** uWSGI is running in multiple interpreter mode *** Jul 28 18:01:00.733685 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: spawned uWSGI master process (pid: 130382) Jul 28 18:01:00.733854 dv-cinder-837543-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 18:01:00.734629 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: spawned uWSGI worker 1 (pid: 130400, cores: 1) Jul 28 18:01:00.734995 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: spawned uWSGI worker 2 (pid: 130401, cores: 1) Jul 28 18:01:00.738559 dv-cinder-837543-7-iscsi devstack@n-api.service[130382]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 18:01:01.406094 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 18:01:01.409419 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 18:01:02.570220 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:01:02.570220 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: from cryptography.utils import int_from_bytes Jul 28 18:01:02.570894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:01:02.570894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: from cryptography.utils import int_from_bytes Jul 28 18:01:02.573451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:01:02.573451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: from cryptography.utils import int_from_bytes Jul 28 18:01:02.573939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 18:01:02.573939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: from cryptography.utils import int_from_bytes Jul 28 18:01:04.990667 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 18:01:04.991340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 18:01:04.991651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 18:01:04.991858 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 18:01:04.992086 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 18:01:04.992477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.992802 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.993123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.993442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.993775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.994086 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.994434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.994761 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.995090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.995350 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.995670 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.995992 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-7-iscsi {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.996313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.996800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.997114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.997438 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.997982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.998329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.999033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:04.999431 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.000991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.000991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.000991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.000991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.001349 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.001426 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.001726 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.002031 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.002361 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.002675 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.003129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-7-iscsi {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.003455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.003768 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.004070 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.004493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.004810 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.005110 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.005431 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.005759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.006068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.006417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.006732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.007050 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.007368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.007680 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.007974 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.008278 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.008599 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.008901 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.009186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.009435 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.009744 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.010062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.010419 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.010724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.010977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.011229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.011535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.011855 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.012165 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.012473 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.012773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.013079 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.014113 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.014461 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.014771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.015085 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.015393 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.015706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.016037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.016341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.016662 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.017061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.017314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.017619 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.017959 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.018276 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.018608 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.018926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.019245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.019549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.019855 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.020158 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.020475 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.020808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.021110 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.021360 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.021659 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.021961 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.022280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.022612 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.022913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.023218 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.023563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.023804 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.024108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.024410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.024712 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.025014 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.025317 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.025490 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 18:01:05.025975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.026157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 18:01:05.026305 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.026491 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 18:01:05.026635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.026635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.026940 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 18:01:05.026940 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 18:01:05.027217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.027217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.027522 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.027663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.027812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.027954 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.028096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.028247 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.028406 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.028548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.028688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.028861 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.029627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.029910 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.030163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.030327 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.030530 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.030682 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.030842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.030993 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.031518 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.031692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.031844 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.031997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.032148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837543-7-iscsi {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.032311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.032456 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.032692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.032692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.033058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.033218 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.033467 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.033626 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.033779 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.033926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.034089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.034319 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.035085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.035249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.035401 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.035543 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.035543 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.035833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.036003 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.036158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.036306 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.036456 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.036612 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.036759 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.036900 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.037051 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.037200 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.037356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.037500 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.037639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.037786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.037937 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.038088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.038311 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.038494 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.038646 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.038788 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.038928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.039074 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.039229 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837543-7-iscsi {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.039382 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.039525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.039727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.039869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.040018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.040181 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.040329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.040329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.040608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.040759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.040901 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.041048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.041214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.041746 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.041909 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.042062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.042211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.042396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.042546 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.042715 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.042937 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.043175 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.043324 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.043493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.043713 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.043868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.044010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.044163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.044329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.044558 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.044774 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.045020 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.045279 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.045473 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.045620 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.045762 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.045964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.046122 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.046274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.046438 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.046582 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.046733 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.046896 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.046896 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.047174 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.047315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.047467 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.047615 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.047771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.047977 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.048129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.048270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.048413 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.048552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.048704 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.048858 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.049013 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.049154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.049302 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.049449 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.049603 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.049796 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.049949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.050099 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.050241 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.050408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.050579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.050728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.050869 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.051008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.051156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.051296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.051469 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.052046 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.052200 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.052350 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.052491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.052631 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.052783 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.052954 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.053184 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.053408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.053562 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.053721 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.053950 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.054131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.054274 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.054494 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.054734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.054897 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.055062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.055333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.055508 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.055651 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.055799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.055949 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.056098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.056239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.056381 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.056536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.056677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.056832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.056974 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.057114 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.057260 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.057412 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.057595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.057755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.057906 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.058152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.058313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.058490 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.058646 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.058835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.058982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.059130 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.059271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.059418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.059579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.059722 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.059902 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.060064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.060355 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.060602 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.060851 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.061087 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.061258 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.061409 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.061552 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.062165 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.062340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.062563 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.062708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.062856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.063012 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.063186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.063427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.063667 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.063816 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.063981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.064208 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.064354 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.064494 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.064655 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.064902 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.065058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.065207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.065348 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.065497 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.065650 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.065793 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.065793 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.066068 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.066221 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.066400 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.066548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.066703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.066929 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.067073 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.067213 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.067362 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.067503 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.067651 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.067803 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.067953 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.068113 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.068845 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.069008 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.069152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.069318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.069462 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.069611 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.069752 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.069942 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.070102 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.070262 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.070441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.070590 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.070742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.070892 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.071048 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.071207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.071357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.071499 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.071647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.071808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.072353 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.072505 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.072647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.072788 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.072928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.073077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.073237 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.073398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.073647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.073869 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.074015 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.074158 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.074543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.074717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.074881 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.075106 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.075265 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.075417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.075559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.076225 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.076389 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.076632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.076876 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.077132 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.077294 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.077294 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 18:01:05.077572 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.077712 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.077899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.078055 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.078246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.079101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.079266 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.079266 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.079562 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.079719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.079862 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.080057 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.080214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.080871 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.081039 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.081191 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.081341 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.081484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.081632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.081774 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.081935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.082378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.082628 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.082775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.083026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.083183 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.083339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.083481 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.083649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.083883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.084107 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.084262 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.084435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.084670 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.084826 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.084968 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.085132 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.085379 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.085534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.085534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.085813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.085961 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.086102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.086256 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.086430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.086584 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.086746 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.086889 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.087036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.087187 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.087329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.087468 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.087618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.087760 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.087901 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.088339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.089394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.089394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.089394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.089394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.089394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.089394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.090307 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.090544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.090735 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.090881 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.091030 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.091171 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.091436 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.091664 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.092832 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.093043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.093296 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.093455 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.093455 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.093760 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.094013 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.094267 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.094437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.094587 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.094840 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.095018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.095166 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.095307 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.095558 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.095705 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.095874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096605 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.096771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.097854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.097854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.097854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.097854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.097854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.098586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.098729 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.098888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.099036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.099186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.099335 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.099335 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.099617 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.099767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.099916 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.100065 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.100258 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.100424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.100574 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.100726 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.100868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.101009 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.101157 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.101298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.101525 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.101525 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.101813 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.101955 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102102 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102251 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.102461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.104022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.104022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.104022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.104022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.104022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.104022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.105222 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.105380 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.105556 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.105785 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.105785 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.106084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.106232 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.106404 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.106558 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.106716 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.106889 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.107529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.107780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.108035 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.108371 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.108549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.108701 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.108859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.109015 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.109175 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.109341 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.109499 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.109647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.109804 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.109972 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.110121 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.110315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.110315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.110315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.110315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.110315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.110315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.110315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.111340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.111340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.111628 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.111628 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.111934 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.112092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.112255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.112403 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.112550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.112696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.113169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.113338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.113497 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.113656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.113927 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.114085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.114252 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.114467 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.114702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.114856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.115018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.115273 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.115439 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.115588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.115759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.115997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.116151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.116299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.116299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.116589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.116755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.116912 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117068 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117377 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117534 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117831 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.117978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.118457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.118622 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.118781 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.118936 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.118936 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.119236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.119390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.119539 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.119685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.119839 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.120001 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.120156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.120356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.120527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.120695 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.120845 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.121004 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.121160 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.121316 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.121472 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.121619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.121619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.121920 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.122069 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.122230 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.122415 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.122668 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.124851 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.125014 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.125173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.125418 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.125593 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.125744 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.125899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.126138 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.126293 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.126469 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.126638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.126794 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.126943 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.127103 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.127260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.127416 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.127574 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.128563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.128740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.128893 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.129051 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.129226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.129390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.129547 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.129705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.129855 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.130027 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.130229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.130479 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.130637 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.130787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.130943 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.131100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.131257 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.131415 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.131571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.131720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.131877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.132034 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.132194 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.132350 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.132499 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.132647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.132802 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.132972 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.132972 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.133257 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.133552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.133708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.134044 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.134314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.134515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.134674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.134841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.135062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.135214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.135386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.135616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.135776 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.135932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.136084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.136335 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.136489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.136646 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.136818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.136967 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.137116 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.137272 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.137429 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.137578 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.137733 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.137880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.138046 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.138547 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.138818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.138992 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.139155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.139326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.139477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.139639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.139796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.139945 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.140100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.140257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.140416 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.140616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.140778 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.140935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.141092 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.141261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.141419 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.141419 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.141711 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.141868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.142016 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.142171 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.142330 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.142529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.142687 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.142844 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.142993 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.143148 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.143320 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.143496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.143728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.143889 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.144225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.144496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.144661 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.144811 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.145050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.145364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.145530 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.145781 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.145939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.146099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.146249 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.146518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.146676 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.146834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.146834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.147123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.147285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.147443 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.148138 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.148315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.148538 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.148694 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.148865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.149023 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.149180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.149337 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.149486 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.149644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.149807 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.149956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.150104 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.150252 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.150418 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.150572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.150796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.150948 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.151096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.151251 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.151400 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.151556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.151714 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.151863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.152018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.152179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.152334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.152492 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.152648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.152809 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.152958 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.153121 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.153278 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.153437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.153585 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.153791 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.154102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.155217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.155480 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.155649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.155895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.156054 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.156224 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.156374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.156549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.156782 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.156782 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.157070 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.157225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.157375 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.157532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.157716 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.157876 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.158034 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.158253 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.158449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.158698 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.158856 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.159005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.159161 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.159311 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.159458 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.159616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.159773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.159930 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.160079 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.160236 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.160406 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.160563 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.160765 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.160918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.161066 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.161216 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.161378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.161534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.161689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.161838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.161993 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.162142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.162299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.162534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.162687 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.162842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.162997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.163154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.163316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.163473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.163630 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.163780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.163941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.164194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.164359 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.165787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.166053 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.166229 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.166400 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.166570 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.166721 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.166974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.167145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.167295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.167454 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.167612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.167612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.167895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.168064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.168221 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.168370 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.168518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.168685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.168913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.169076 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.169235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.169899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.170059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.170248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.170507 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.170850 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.171069 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.171225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.171375 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.171523 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.171523 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.171820 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.171976 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.172133 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.172282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.172437 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.172597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.172747 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.172904 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.173063 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.173220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.173377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.173539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.173696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.173854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.174020 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.174196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.174484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.174654 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.175018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.175180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.175350 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.175501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.175850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.176035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.176264 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.176428 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.176428 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.176991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.177238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.177401 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.177551 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.177699 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.178005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.178187 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.178387 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.178554 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.178700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.178792 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.178893 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.178979 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179264 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179345 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179756 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179845 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.179935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180119 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180209 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180389 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.180944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181195 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181368 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181529 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181773 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181853 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.181935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182395 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182492 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182575 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182670 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.182931 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183027 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183122 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183213 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183296 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183384 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183466 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183547 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183547 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183703 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183791 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183878 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.183965 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184143 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184421 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184512 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184607 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184875 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.184982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.185908 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.186063 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.186214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.186466 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.186641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.186749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.186835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.186926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187017 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187219 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187499 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187582 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187671 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187753 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.187999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188191 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188273 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188362 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188526 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.188970 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189140 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189287 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189458 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189881 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.189964 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190053 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190142 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190317 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190687 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.190908 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191023 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191115 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191286 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191369 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191450 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191539 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191712 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.191920 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192001 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192086 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192405 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192592 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192676 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192765 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192847 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.192934 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193087 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193185 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193347 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193428 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193508 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193685 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193774 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193855 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.193946 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194040 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194221 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194307 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194414 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194499 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194682 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194762 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194850 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.194941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.195111 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.195886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.195989 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196063 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196165 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196261 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196360 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196689 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196778 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.196972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197055 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197055 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197204 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197294 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197449 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197607 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197789 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197872 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.197953 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.198040 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.198122 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.198203 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.198296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199040 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199227 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199309 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199388 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199558 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199819 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.199912 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200269 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200352 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200352 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200792 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.200957 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201278 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201439 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201520 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.201938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.202108 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.202216 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.202467 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.202590 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.202803 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.202897 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.203117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.203211 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.203476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.203599 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.203806 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.203902 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.204803 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.204967 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.205109 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.205264 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.205489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.205489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.205714 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.206011 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.206325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.206509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.206664 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.206943 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.207026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.207274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.207368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.207584 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.207755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.207923 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.208115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.208235 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.208561 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.208920 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.209237 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.209330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.209571 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.209698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.209911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.210043 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.210227 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211160 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211307 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211499 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211575 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211746 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211829 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.211923 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.212006 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.212078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.212206 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.212397 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.212649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.212742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.213040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.213134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.213365 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.213456 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.213695 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.213788 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.214075 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.214284 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.214417 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.214642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.214800 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.214989 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.215137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.215331 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.215685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.215797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.215898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.216171 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.216528 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.216528 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.216767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.216918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.217064 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.217282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.217386 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.217597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.217696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.217923 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.218016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.218248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.218367 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.218593 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.218684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.218930 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.219168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.219267 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.219509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.219604 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.219842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.220039 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.220199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.220364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.220515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.220751 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.220994 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.221158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.221308 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.221457 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.221612 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.221765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.221929 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.222194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.222380 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.222549 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.222719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.222877 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.223042 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.223192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.223348 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.223503 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.223653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.223815 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.223972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.224123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.224272 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.224427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.224587 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.224587 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.224885 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.225034 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.225184 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.225332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.225505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.225822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.225986 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.226143 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.226310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.226514 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.226686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.226921 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.227076 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.227225 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.227374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.227530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.227708 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.227936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.228093 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.228250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.228400 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.228548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.228706 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.228867 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.229032 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.229180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.229330 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.229488 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.229655 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.229877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.230031 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.230189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.230339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.230526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.230684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.230845 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.231002 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.231151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.231300 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.231459 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.231622 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.231783 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.232619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.232862 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.233112 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.233363 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.233533 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.233692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.233866 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.234017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.234017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.234324 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.234324 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.234708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.234863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.235010 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.235172 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.235334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.235487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.235638 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.235947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.236119 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.236371 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.236546 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.236706 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.236867 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.237105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.237105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.237421 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.237572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.237722 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.237878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.238118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.238298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.238475 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.238625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.238786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.238944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.239095 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.239095 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.239391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.239540 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.239696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.239866 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.240099 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.240268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.240443 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.240601 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.240601 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.240915 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.241080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.241231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.241384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.241534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.241700 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.241850 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.242008 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.242179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.242334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.242548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.242805 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.242961 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.243128 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.243278 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.243434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.243583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.243743 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.243900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.244061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.244210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.244364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.244531 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.244690 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.244854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.245016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.245174 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.245331 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.245480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.245628 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.245793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.246098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.246256 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.246434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.246598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.246766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.246930 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.247099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.247318 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.247318 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.247683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.247887 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.249039 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.249287 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.249447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.249605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.249763 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.249939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.250110 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.250332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.250568 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.250719 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.250882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.251043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.251200 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.251351 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.251501 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.251657 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.251811 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.251969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.252142 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.252301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.252452 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.252601 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.252758 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.253024 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.253209 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.253925 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.254096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.254248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.254508 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.254671 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.254829 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.254990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.255149 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.255305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.255469 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.255673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.255825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.255982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.256323 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.256489 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.256641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.256641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.256932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.257114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.257274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.257467 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.257627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.257806 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.257958 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.258115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.258272 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.258474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.258629 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.258779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.259597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.259772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.259938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.260100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.260100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.260478 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.260636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.260796 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.260957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.261113 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.261271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.261421 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.261579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.261746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.261923 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.262074 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.262223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.262391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.262548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.262697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.262863 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.263040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.263415 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.263948 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.264161 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.264322 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.264484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.264645 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.264796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.264952 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.265105 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.265264 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.265422 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.265572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.265722 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.265870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.266021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.266180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.266555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.266723 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.266893 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.267050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.267202 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.267364 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.267523 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.267685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.267841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.267998 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.267998 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.268302 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.268459 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.268608 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.268774 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.268939 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.269210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.269384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.269550 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.269718 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.269877 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.270027 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.270191 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.270343 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.270596 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.270753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.270913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.271078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.271243 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.271407 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.271564 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.271714 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.271870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.272047 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.272203 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.272352 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.272510 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.272660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.272809 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.272982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.273145 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.273295 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.273548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.273714 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.273865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.274024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.274024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.274317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.274526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.274684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.274848 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.275008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.275167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.275316 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.275466 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.275616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.275774 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.275924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.276080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.276229 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.276378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.276694 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.276861 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.277919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.278030 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.278136 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.278235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.278334 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.278503 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.278653 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.279377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.279473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.279546 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.279627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.279713 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.279793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.279877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.279976 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280233 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280454 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280538 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280623 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280623 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280837 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.280930 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281023 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281208 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130400) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 18:01:05.281451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.281451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.282081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.282081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.282081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.282081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.282081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.282081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.282531 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.283231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.283597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.283900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.284238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.284546 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.284987 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.285693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.286180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.286963 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.287385 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.287823 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.288217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.288559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.288940 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.289268 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.289595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.289939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.290262 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.290624 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.290947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.291268 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.291588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.291920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.292241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.292561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.292888 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.293214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.293550 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.293884 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.294204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.295114 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.295461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.295814 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.296135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.296491 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.296828 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.297150 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.297472 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.297786 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 18:01:05.298038 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130401) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 18:01:05.339053 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO dbcounter [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Registered counter for database nova_api Jul 28 18:01:05.361008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO dbcounter [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Registered counter for database nova_api Jul 28 18:01:05.361196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_db.sqlalchemy.engines [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:01:05.368422 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writer thread running {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:01:05.381939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_db.sqlalchemy.engines [None req-5583488b-98e8-4aef-a920-c770db318760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:01:05.388994 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writer thread running {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:01:05.426881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.context [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),34fd1832-dad1-4ec6-9afc-d537dee5a553(cell1) {{(pid=130400) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 18:01:05.431210 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:05.432818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:05.433641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:05.435790 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:05.437978 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO dbcounter [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Registered counter for database nova_cell0 Jul 28 18:01:05.442314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO dbcounter [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Registered counter for database nova_cell1 Jul 28 18:01:05.449013 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.context [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),34fd1832-dad1-4ec6-9afc-d537dee5a553(cell1) {{(pid=130401) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 18:01:05.451330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_db.sqlalchemy.engines [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:01:05.452342 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_db.sqlalchemy.engines [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:01:05.454325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:05.455951 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:05.456921 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:01:05.458976 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:01:05.460595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writer thread running {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:01:05.460950 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writer thread running {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:01:05.461061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO dbcounter [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Registered counter for database nova_cell0 Jul 28 18:01:05.466046 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO dbcounter [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Registered counter for database nova_cell1 Jul 28 18:01:05.475121 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_db.sqlalchemy.engines [None req-5583488b-98e8-4aef-a920-c770db318760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:01:05.478571 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_db.sqlalchemy.engines [None req-5583488b-98e8-4aef-a920-c770db318760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:01:05.484847 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writer thread running {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:01:05.617342 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO dbcounter [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Registered counter for database nova_cell0 Jul 28 18:01:05.624375 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_db.sqlalchemy.engines [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130400) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:01:05.625389 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writer thread running {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:01:05.629053 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writer thread running {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:01:05.635589 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO dbcounter [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Registered counter for database nova_cell0 Jul 28 18:01:05.642865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_db.sqlalchemy.engines [None req-5583488b-98e8-4aef-a920-c770db318760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130401) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 18:01:05.647330 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writer thread running {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 18:01:05.947496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: WARNING keystonemiddleware.auth_token [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:01:05.955376 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: WARNING keystonemiddleware.auth_token [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:01:05.964870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: WARNING keystonemiddleware.auth_token [None req-5583488b-98e8-4aef-a920-c770db318760 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:01:05.972449 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: WARNING keystonemiddleware.auth_token [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:01:06.300131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: WARNING keystonemiddleware.auth_token [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:01:06.306153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: WARNING keystonemiddleware.auth_token [None req-7550ca54-a8d4-4f16-990c-71a736e1555b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:01:06.312297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7ab1fb9c0 pid: 130400 (default app) Jul 28 18:01:06.317817 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: WARNING keystonemiddleware.auth_token [None req-5583488b-98e8-4aef-a920-c770db318760 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 18:01:06.323883 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: WARNING keystonemiddleware.auth_token [None req-5583488b-98e8-4aef-a920-c770db318760 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 18:01:06.329308 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7ab1fb9c0 pid: 130401 (default app) Jul 28 18:01:48.455824 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:48.457550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:48.458327 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:48.459273 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:49.850389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2c1bdafc-5ed6-4b76-aa2e-8a27dc94d051 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Action: 'create', calling method: .version_select at 0x7fdae1ae7d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1224740821"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:01:50.000323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=3 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:50.005505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=3 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:50.007054 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=3 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:50.007874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=3 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:01:50.609671 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2f6a61d5-b8e7-49f3-afcf-5df45016770f tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Action: 'create', calling method: .version_select at 0x7fdae1afbd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1664022481", "metadata": {"Type": "work"}}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:01:52.270009 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2c1bdafc-5ed6-4b76-aa2e-8a27dc94d051 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.823668 Jul 28 18:01:52.271364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 1/1] 10.222.0.85 () {60 vars in 1155 bytes} [Thu Jul 28 18:01:48 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3827 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 18:01:52.289826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4a17051b-207b-47c2-bdba-f1226d141ee0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae1952b80>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:52.518753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4a17051b-207b-47c2-bdba-f1226d141ee0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f" status: 200 len: 345 microversion: 2.1 time: 0.236403 Jul 28 18:01:52.519343 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 2/2] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:52 2022] GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f => generated 345 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:01:52.550671 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2f6a61d5-b8e7-49f3-afcf-5df45016770f tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.553906 Jul 28 18:01:52.551480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1156 bytes} [Thu Jul 28 18:01:49 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2559 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 28 18:01:52.574766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cce785ef-f521-42f4-813f-cab4b0a33dff tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae1964280>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:52.698761 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cce785ef-f521-42f4-813f-cab4b0a33dff tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 200 len: 353 microversion: 2.1 time: 0.136229 Jul 28 18:01:52.705578 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 3/4] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:52 2022] GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:52.977046 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0ec39829-094a-40da-9543-d256fa717c1a tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae194aaf0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:53.111807 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0ec39829-094a-40da-9543-d256fa717c1a tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e0bd0bf6-7109-495a-873e-2c010fba8e16" status: 200 len: 350 microversion: 2.1 time: 0.140814 Jul 28 18:01:53.112692 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 2/5] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:52 2022] GET /compute/v2.1/os-volumes/e0bd0bf6-7109-495a-873e-2c010fba8e16 => generated 350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:53.534557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2da96467-36b1-482e-a26b-8d0ac35b351a tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae19649d0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:53.632440 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2da96467-36b1-482e-a26b-8d0ac35b351a tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f" status: 200 len: 346 microversion: 2.1 time: 0.102314 Jul 28 18:01:53.633457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 4/6] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:53 2022] GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:53.650498 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ad7e7c58-8b70-4f12-9a21-8acace4d6648 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Action: 'create', calling method: .version_select at 0x7fdae19671f0>, body: {"snapshot": {"volume_id": "577e0751-d114-4573-a4ba-4814d623c52f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-211833016"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:01:53.716478 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d0391a34-2884-4df6-a231-d083ea9a9497 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae1952dc0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:54.467100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d0391a34-2884-4df6-a231-d083ea9a9497 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 200 len: 354 microversion: 2.1 time: 0.756442 Jul 28 18:01:54.467753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 5/7] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:53 2022] GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 354 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:54.481904 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-892df60a-9513-473a-a7e0-d21dc9a2444b tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae1964c10>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:54.633826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-892df60a-9513-473a-a7e0-d21dc9a2444b tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 200 len: 354 microversion: 2.1 time: 0.156238 Jul 28 18:01:54.636073 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 6/8] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:54 2022] GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 354 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:54.649109 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6339c9f5-7d2d-48f3-a9d1-1e7e432662a6 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae1964430>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:55.271894 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ad7e7c58-8b70-4f12-9a21-8acace4d6648 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.625601 Jul 28 18:01:55.275091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 3/9] 10.222.0.85 () {60 vars in 1162 bytes} [Thu Jul 28 18:01:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:55.295402 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f7c28b00-e763-4f0e-9a47-2593d861166c tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae1966310>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:55.539326 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6339c9f5-7d2d-48f3-a9d1-1e7e432662a6 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 202 len: 0 microversion: 2.1 time: 0.893659 Jul 28 18:01:55.539538 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 7/10] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:01:54 2022] DELETE /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 0 bytes in 895 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:01:55.549015 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-53211ba5-53dc-4ec8-a0a4-01ef6abdacc3 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae1952d30>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:55.585210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f7c28b00-e763-4f0e-9a47-2593d861166c tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa" status: 200 len: 286 microversion: 2.1 time: 0.303256 Jul 28 18:01:55.586792 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 4/11] 10.222.0.85 () {58 vars in 1251 bytes} [Thu Jul 28 18:01:55 2022] GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa => generated 286 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:55.597958 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d01a0920-d930-4563-89be-02c11729a02f tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae1967d30>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:55.690409 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-53211ba5-53dc-4ec8-a0a4-01ef6abdacc3 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 200 len: 353 microversion: 2.1 time: 0.145432 Jul 28 18:01:55.691709 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 8/12] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:55 2022] GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:01:55.779715 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d01a0920-d930-4563-89be-02c11729a02f tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.186285 Jul 28 18:01:55.780165 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 5/13] 10.222.0.85 () {58 vars in 1140 bytes} [Thu Jul 28 18:01:55 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:01:55.793529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff829c9c-836f-4ac3-b912-ba6acc9e5bab tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae1964160>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:55.880187 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ff829c9c-836f-4ac3-b912-ba6acc9e5bab tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa" status: 200 len: 286 microversion: 2.1 time: 0.092470 Jul 28 18:01:55.881129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 9/14] 10.222.0.85 () {58 vars in 1251 bytes} [Thu Jul 28 18:01:55 2022] GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:56.715073 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-41906ec1-d8e9-4b03-81a6-9d1a9f8b0230 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae194ab80>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:56.813491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e1495f3d-d63f-41ee-9d8a-c4e10b92e934 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae1964b80>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:56.840997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-41906ec1-d8e9-4b03-81a6-9d1a9f8b0230 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 200 len: 353 microversion: 2.1 time: 0.131527 Jul 28 18:01:56.845751 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 6/15] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:56 2022] GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:56.895415 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-df9a6b46-9fae-49a9-a56c-d97af9f890e0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae19660d0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:56.928606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e1495f3d-d63f-41ee-9d8a-c4e10b92e934 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/cdbca3d7-4c39-4a28-a63f-4a3d25996c3e" status: 200 len: 351 microversion: 2.1 time: 0.118967 Jul 28 18:01:56.938306 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 10/16] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:56 2022] GET /compute/v2.1/os-volumes/cdbca3d7-4c39-4a28-a63f-4a3d25996c3e => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:56.976392 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-df9a6b46-9fae-49a9-a56c-d97af9f890e0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa" status: 200 len: 286 microversion: 2.1 time: 0.086306 Jul 28 18:01:56.978782 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 7/17] 10.222.0.85 () {58 vars in 1251 bytes} [Thu Jul 28 18:01:56 2022] GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:57.853329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-158d0840-cfdd-4a7b-9754-0f4dc72a4d6f tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae1964ca0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:57.960624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-158d0840-cfdd-4a7b-9754-0f4dc72a4d6f tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 200 len: 353 microversion: 2.1 time: 0.111702 Jul 28 18:01:57.975307 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 11/18] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:57 2022] GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:57.998098 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6f1a43c7-dbb9-4ad8-bdc8-336881c00886 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae194aca0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:58.056492 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6f1a43c7-dbb9-4ad8-bdc8-336881c00886 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa" status: 200 len: 286 microversion: 2.1 time: 0.063415 Jul 28 18:01:58.057931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 8/19] 10.222.0.85 () {58 vars in 1251 bytes} [Thu Jul 28 18:01:57 2022] GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:58.979741 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-27bea81c-d90a-46a9-a0f3-353016fc541f tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae19641f0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:59.071424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4659d140-000c-4b28-8518-b08aa954aafa tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae19674c0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:59.147835 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-27bea81c-d90a-46a9-a0f3-353016fc541f tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 200 len: 353 microversion: 2.1 time: 0.174647 Jul 28 18:01:59.149136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 12/20] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:01:58 2022] GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:59.181158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4659d140-000c-4b28-8518-b08aa954aafa tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa" status: 200 len: 287 microversion: 2.1 time: 0.113170 Jul 28 18:01:59.181158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 9/21] 10.222.0.85 () {58 vars in 1251 bytes} [Thu Jul 28 18:01:59 2022] GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:01:59.196090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-196896f8-ee41-4035-b7ab-e82783668bb5 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae1952f70>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:59.403257 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-196896f8-ee41-4035-b7ab-e82783668bb5 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa" status: 202 len: 0 microversion: 2.1 time: 0.213264 Jul 28 18:01:59.404000 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 13/22] 10.222.0.85 () {58 vars in 1254 bytes} [Thu Jul 28 18:01:59 2022] DELETE /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:01:59.415588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f2949a58-663e-475d-ba97-d537d045b4cf tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae1967ca0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:01:59.483948 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f2949a58-663e-475d-ba97-d537d045b4cf tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa" status: 200 len: 286 microversion: 2.1 time: 0.072920 Jul 28 18:01:59.483948 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 10/23] 10.222.0.85 () {58 vars in 1251 bytes} [Thu Jul 28 18:01:59 2022] GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:00.036730 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9537d42f-c2b9-445d-9fc0-906108b4b9ac tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae19731f0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:00.144736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9537d42f-c2b9-445d-9fc0-906108b4b9ac tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/4d8bf442-277a-4768-b6ea-dc43754964a3" status: 200 len: 351 microversion: 2.1 time: 0.109065 Jul 28 18:02:00.159989 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 14/24] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:02:00 2022] GET /compute/v2.1/os-volumes/4d8bf442-277a-4768-b6ea-dc43754964a3 => generated 351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:00.162749 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a1fe0438-69d4-44ab-b771-3af80c84cb9c tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae1afbe50>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:00.171328 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-02494b4b-99f0-4aee-8141-d8f70ab09167 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Calling method '.version_select at 0x7fdae1952d30>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:00.263881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-02494b4b-99f0-4aee-8141-d8f70ab09167 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] HTTP exception thrown: Volume 32e02691-aac7-4623-83b4-1fef388ff4e4 could not be found. Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-02494b4b-99f0-4aee-8141-d8f70ab09167 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Request method failure captured: Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 HTTP/1.1 Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8NzJxxSWGDdcuNk_dzc0mH5zcUvjL4pIf4lsvvaFip0qaLHSByQiOi1YzelnfzdmdFlVtAYM_HqPIkAsDIEYFUK8j13zno9Ilr9egHoSghsHvex8TK4s9LN4aoYUQv3H1HWfh157vS80zkGIMJSKp_blMJEr3dORiT87vQacBvOUM Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: c39bbb5307284385a11288bb3246b357 Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesGetTestJSON-1505330073 Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:02:00.269301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c39bbb5307284385a11288bb3246b357"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c39bbb5307284385a11288bb3246b357", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c39bbb5307284385a11288bb3246b357"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c39bbb5307284385a11288bb3246b357"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesGetTestJSON-1505330073 Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: c39bbb5307284385a11288bb3246b357 Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesGetTestJSON-1505330073 Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesGetTestJSON-1505330073-project Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 9b9c9bfc24d846f294b3ceef65cc0efc Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesGetTestJSON-1505330073-project Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Volume 32e02691-aac7-4623-83b4-1fef388ff4e4 could not be found. Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '32e02691-aac7-4623-83b4-1fef388ff4e4'} Jul 28 18:02:00.270706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32e02691-aac7-4623-83b4-1fef388ff4e4 could not be found. (HTTP 404) (Request-ID: req-c7148719-db8c-4bbf-b292-2564192645c0) Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:00.271535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:00.274938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32e02691-aac7-4623-83b4-1fef388ff4e4 could not be found. Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 18:02:00.278162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32e02691-aac7-4623-83b4-1fef388ff4e4 could not be found. Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32e02691-aac7-4623-83b4-1fef388ff4e4 could not be found. Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.281389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-02494b4b-99f0-4aee-8141-d8f70ab09167 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] Returning 404 to user: Volume 32e02691-aac7-4623-83b4-1fef388ff4e4 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:00.288698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-02494b4b-99f0-4aee-8141-d8f70ab09167 tempest-VolumesGetTestJSON-1505330073 tempest-VolumesGetTestJSON-1505330073-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4" status: 404 len: 109 microversion: 2.1 time: 0.124279 Jul 28 18:02:00.290669 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 15/25] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:02:00 2022] GET /compute/v2.1/os-volumes/32e02691-aac7-4623-83b4-1fef388ff4e4 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:00.372294 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a1fe0438-69d4-44ab-b771-3af80c84cb9c tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.213734 Jul 28 18:02:00.395920 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-05474b98-62c5-48b2-a783-a3c2d35ad7aa tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae22db040>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:00.397157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 11/26] 10.222.0.85 () {58 vars in 1134 bytes} [Thu Jul 28 18:02:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:00.497717 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f8e586d1-c925-445b-aa8e-9b94ac559485 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae19674c0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:00.564617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-f8e586d1-c925-445b-aa8e-9b94ac559485 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] HTTP exception thrown: Snapshot 30e1d815-50a6-4f64-a1d6-daa5cb879afa could not be found. Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f8e586d1-c925-445b-aa8e-9b94ac559485 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Request method failure captured: Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa HTTP/1.1 Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8MYPf65tM08FWMg-k4xr6PyEBPNSXN7GwZn_Oi0VOqjuzGLKCtWD09u4SBd57bxLheX_iVC6fXNqCp3OdC0npX2F6-AqB8fgwkivty8BJFq33ZuigDryuHrLWs1Kkhp9zIQUClnmcSy_itXlA_tNxu3ebFHtIs7DOjyGgpAdRHOBo Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 6f1877c26b444f2489b836a1297c9cb0 Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:02:00.568673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6f1877c26b444f2489b836a1297c9cb0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 6f1877c26b444f2489b836a1297c9cb0 Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-VolumesSnapshotsTestJSON-1818464365-project Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 0c53da1828944c24ae1944ac8781c5f2 Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1818464365-project Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Snapshot 30e1d815-50a6-4f64-a1d6-daa5cb879afa could not be found. Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '30e1d815-50a6-4f64-a1d6-daa5cb879afa'} Jul 28 18:02:00.575626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 30e1d815-50a6-4f64-a1d6-daa5cb879afa could not be found. (HTTP 404) (Request-ID: req-78f3aa34-7be8-40d0-9ad3-673c002fc2c2) Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.576617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:00.577465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 30e1d815-50a6-4f64-a1d6-daa5cb879afa could not be found. Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 18:02:00.578505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 30e1d815-50a6-4f64-a1d6-daa5cb879afa could not be found. Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 30e1d815-50a6-4f64-a1d6-daa5cb879afa could not be found. Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f8e586d1-c925-445b-aa8e-9b94ac559485 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Returning 404 to user: Snapshot 30e1d815-50a6-4f64-a1d6-daa5cb879afa could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:00.580638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f8e586d1-c925-445b-aa8e-9b94ac559485 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa" status: 404 len: 111 microversion: 2.1 time: 0.078281 Jul 28 18:02:00.582073 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 12/27] 10.222.0.85 () {58 vars in 1251 bytes} [Thu Jul 28 18:02:00 2022] GET /compute/v2.1/os-snapshots/30e1d815-50a6-4f64-a1d6-daa5cb879afa => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:00.588941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-05474b98-62c5-48b2-a783-a3c2d35ad7aa tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.197302 Jul 28 18:02:00.589506 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 16/28] 10.222.0.85 () {58 vars in 1149 bytes} [Thu Jul 28 18:02:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:02:00.607171 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c583d6a4-8197-42a3-9bd5-4eae9b672a20 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae1973e50>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:00.610598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6026e06e-4df1-4b95-b7c9-2eab21bb1795 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae194adc0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:00.741536 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c583d6a4-8197-42a3-9bd5-4eae9b672a20 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.139593 Jul 28 18:02:00.751314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 17/29] 10.222.0.85 () {58 vars in 1134 bytes} [Thu Jul 28 18:02:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:00.757150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b89f8371-eb4b-4d35-9c65-6c9730051f98 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae18db0d0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:01.036234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6026e06e-4df1-4b95-b7c9-2eab21bb1795 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f" status: 202 len: 0 microversion: 2.1 time: 0.458627 Jul 28 18:02:01.038051 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 13/30] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:02:00 2022] DELETE /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f => generated 0 bytes in 461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:02:01.052298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b2b2f0b8-174a-4fea-86cc-4ebf60f2df7a tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae1967820>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:01.282084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b89f8371-eb4b-4d35-9c65-6c9730051f98 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.529091 Jul 28 18:02:01.283908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 18/31] 10.222.0.85 () {58 vars in 1167 bytes} [Thu Jul 28 18:02:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:01.297209 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5ae6b635-23cb-49e6-9246-8f336f25980f tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae18dba60>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:01.406186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b2b2f0b8-174a-4fea-86cc-4ebf60f2df7a tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f" status: 200 len: 345 microversion: 2.1 time: 0.360981 Jul 28 18:02:01.407913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 14/32] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:02:01 2022] GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f => generated 345 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:01.644745 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5ae6b635-23cb-49e6-9246-8f336f25980f tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.351686 Jul 28 18:02:01.645817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 19/33] 10.222.0.85 () {58 vars in 1170 bytes} [Thu Jul 28 18:02:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:01.660627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fd93774a-25eb-4d49-864e-b660ee948563 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae193f550>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:01.881655 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fd93774a-25eb-4d49-864e-b660ee948563 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.225563 Jul 28 18:02:01.882994 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 15/34] 10.222.0.85 () {58 vars in 1155 bytes} [Thu Jul 28 18:02:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:01.896033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fc99c1b4-9031-473b-a747-392452af4d77 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae18d55e0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:02.238275 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fc99c1b4-9031-473b-a747-392452af4d77 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.346037 Jul 28 18:02:02.238966 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 20/35] 10.222.0.85 () {58 vars in 1188 bytes} [Thu Jul 28 18:02:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:02.253432 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-09ec4353-f285-4e36-81b8-de5e471909d9 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] Calling method '.version_select at 0x7fdae1973940>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:02.410730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1158523405", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "networks": [{"uuid": "7f260d9f-0f92-4a2e-be08-bf7b97fbd32e"}]}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:02.481826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-09ec4353-f285-4e36-81b8-de5e471909d9 tempest-VolumesTestJSON-545357234 tempest-VolumesTestJSON-545357234-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.232228 Jul 28 18:02:02.483039 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 21/36] 10.222.0.85 () {58 vars in 1155 bytes} [Thu Jul 28 18:02:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:02.487894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fbf1d1f6-41cc-444e-a2d8-3709a2a95ed8 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae1baddc0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:02.539425 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-fbf1d1f6-41cc-444e-a2d8-3709a2a95ed8 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] HTTP exception thrown: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fbf1d1f6-41cc-444e-a2d8-3709a2a95ed8 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Request method failure captured: Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f HTTP/1.1 Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8MYPf65tM08FWMg-k4xr6PyEBPNSXN7GwZn_Oi0VOqjuzGLKCtWD09u4SBd57bxLheX_iVC6fXNqCp3OdC0npX2F6-AqB8fgwkivty8BJFq33ZuigDryuHrLWs1Kkhp9zIQUClnmcSy_itXlA_tNxu3ebFHtIs7DOjyGgpAdRHOBo Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 6f1877c26b444f2489b836a1297c9cb0 Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:02:02.544430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6f1877c26b444f2489b836a1297c9cb0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 6f1877c26b444f2489b836a1297c9cb0 Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesSnapshotsTestJSON-1818464365-project Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 0c53da1828944c24ae1944ac8781c5f2 Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1818464365-project Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '577e0751-d114-4573-a4ba-4814d623c52f'} Jul 28 18:02:02.545779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. (HTTP 404) (Request-ID: req-c52bbe1a-34fd-4db7-940b-18b312810f6a) Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.546653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:02.547795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 18:02:02.548665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fbf1d1f6-41cc-444e-a2d8-3709a2a95ed8 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Returning 404 to user: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:02.550206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fbf1d1f6-41cc-444e-a2d8-3709a2a95ed8 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f" status: 404 len: 109 microversion: 2.1 time: 0.062147 Jul 28 18:02:02.555236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 22/37] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:02:02 2022] GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:02.566480 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-977da2e1-339f-43f1-86db-20ba63e04b18 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae18d5f70>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:02.624886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-977da2e1-339f-43f1-86db-20ba63e04b18 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] HTTP exception thrown: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-977da2e1-339f-43f1-86db-20ba63e04b18 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Request method failure captured: Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: DELETE /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f HTTP/1.1 Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8MYPf65tM08FWMg-k4xr6PyEBPNSXN7GwZn_Oi0VOqjuzGLKCtWD09u4SBd57bxLheX_iVC6fXNqCp3OdC0npX2F6-AqB8fgwkivty8BJFq33ZuigDryuHrLWs1Kkhp9zIQUClnmcSy_itXlA_tNxu3ebFHtIs7DOjyGgpAdRHOBo Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 6f1877c26b444f2489b836a1297c9cb0 Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:02:02.627163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6f1877c26b444f2489b836a1297c9cb0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 6f1877c26b444f2489b836a1297c9cb0 Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesSnapshotsTestJSON-1818464365-project Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 0c53da1828944c24ae1944ac8781c5f2 Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1818464365-project Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '577e0751-d114-4573-a4ba-4814d623c52f'} Jul 28 18:02:02.628217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. (HTTP 404) (Request-ID: req-45263531-fb41-4b2c-8373-e080c736a86b) Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.628846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:02:02.629965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 18:02:02.630896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.635618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.637237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-977da2e1-339f-43f1-86db-20ba63e04b18 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Returning 404 to user: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:02.638068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-977da2e1-339f-43f1-86db-20ba63e04b18 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f" status: 404 len: 109 microversion: 2.1 time: 0.080135 Jul 28 18:02:02.638858 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 23/38] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:02:02 2022] DELETE /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:02.647911 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bf82b7b8-3c7b-4487-85fe-392ab57fbea0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Calling method '.version_select at 0x7fdae18d50d0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:02.660726 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.network.neutron [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] validate_networks() for [('7f260d9f-0f92-4a2e-be08-bf7b97fbd32e', None, None, None, None, None)] {{(pid=130401) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:02:02.683275 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-bf82b7b8-3c7b-4487-85fe-392ab57fbea0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] HTTP exception thrown: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bf82b7b8-3c7b-4487-85fe-392ab57fbea0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Request method failure captured: Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f HTTP/1.1 Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8MYPf65tM08FWMg-k4xr6PyEBPNSXN7GwZn_Oi0VOqjuzGLKCtWD09u4SBd57bxLheX_iVC6fXNqCp3OdC0npX2F6-AqB8fgwkivty8BJFq33ZuigDryuHrLWs1Kkhp9zIQUClnmcSy_itXlA_tNxu3ebFHtIs7DOjyGgpAdRHOBo Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 6f1877c26b444f2489b836a1297c9cb0 Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:02:02.685442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6f1877c26b444f2489b836a1297c9cb0", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6f1877c26b444f2489b836a1297c9cb0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 6f1877c26b444f2489b836a1297c9cb0 Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1818464365 Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesSnapshotsTestJSON-1818464365-project Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 0c53da1828944c24ae1944ac8781c5f2 Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1818464365-project Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '577e0751-d114-4573-a4ba-4814d623c52f'} Jul 28 18:02:02.686498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. (HTTP 404) (Request-ID: req-df830b91-87e7-4120-a102-3ca584c942ac) Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.687125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:02.687984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 18:02:02.689698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bf82b7b8-3c7b-4487-85fe-392ab57fbea0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] Returning 404 to user: Volume 577e0751-d114-4573-a4ba-4814d623c52f could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bf82b7b8-3c7b-4487-85fe-392ab57fbea0 tempest-VolumesSnapshotsTestJSON-1818464365 tempest-VolumesSnapshotsTestJSON-1818464365-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f" status: 404 len: 109 microversion: 2.1 time: 0.043991 Jul 28 18:02:02.690594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 24/39] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:02:02 2022] GET /compute/v2.1/os-volumes/577e0751-d114-4573-a4ba-4814d623c52f => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:03.630588 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1490789839", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:03.760957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] validate_networks() for [('3d1691a3-9020-429a-9c4e-b3ff2213b5a2', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:02:05.155455 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Flavor limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:02:05.156050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Image limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:02:05.156486 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Flavor pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:02:05.157084 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Image pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:02:05.158177 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:02:05.185659 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:05.186121 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:05.186964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:05.187541 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:05.231426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Getting quotas for project e993449a4d58431cada94ec21f5a13d9. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:02:05.259058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Getting quotas for user 40605f70e0034578acbfc67f7b78b1d0 and project e993449a4d58431cada94ec21f5a13d9. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:02:05.271037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:02:05.272006 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:02:05.272786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:02:05.273595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:02:05.274198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:02:05.296459 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Going to run 1 instances... {{(pid=130401) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:02:05.302559 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:05.303861 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:05.304894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:05.305035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:02:05.306490 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:05.356056 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Getting quotas for project c1c1587cf20d427e8bb03ffae1b1ce33. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:02:05.368574 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Getting quotas for user 564e0f9000a1448ea9ea37a2892e6495 and project c1c1587cf20d427e8bb03ffae1b1ce33. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:02:05.394154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:02:05.399814 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:02:05.603486 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-feeb696f-c14f-4ed0-aae6-155631ce857d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.478955 Jul 28 18:02:05.606061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 16/40] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:02:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:02:05.620931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bb130a66-8c36-48e6-8b13-e5e68e7b279d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:05.621910 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bb130a66-8c36-48e6-8b13-e5e68e7b279d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:05.686207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c739794b-0ab8-448f-9968-a112e24e1cd8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.276145 Jul 28 18:02:05.687529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 25/41] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:02:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:02:05.727063 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-848b5868-7e4f-4c91-a679-867edb6591f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:05.730096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-848b5868-7e4f-4c91-a679-867edb6591f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:05.978300 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bb130a66-8c36-48e6-8b13-e5e68e7b279d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:05.979133 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-848b5868-7e4f-4c91-a679-867edb6591f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:06.002842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-848b5868-7e4f-4c91-a679-867edb6591f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1222 microversion: 2.1 time: 0.286624 Jul 28 18:02:06.014385 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 26/42] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:05 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:06.018082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bb130a66-8c36-48e6-8b13-e5e68e7b279d tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1215 microversion: 2.1 time: 0.403835 Jul 28 18:02:06.021873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 17/43] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:05 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1215 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:06.841258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-785795817", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:06.965347 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.network.neutron [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] validate_networks() for [('3d1691a3-9020-429a-9c4e-b3ff2213b5a2', None, None, None, None, None)] {{(pid=130401) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:02:07.169302 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-757b5ecd-f8ec-46b6-ad1f-af2f494254da tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Action: 'create', calling method: .version_select at 0x7fdae0fcbdc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1020989774", "metadata": {"Type": "work"}}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-757b5ecd-f8ec-46b6-ad1f-af2f494254da tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Request method failure captured: Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 122 Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8d-jEATVF7C4G-cLqmkK-PPk-A-8jEB5LlHKeS9jftSvTeyFl4rqT_MNQ10PRGcX0xejtRkLF0Y0myuzip8B7BEr7UN8w2ZbvQ3TKTU10nrBbQPaO-BE6bpIuYpLJ3kAnoWIplgXgdOvt4iz2aO8mdICQ4z47LQhZOMIXvycwwBdM Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:02:07.174702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8f3bb1d4e49c4c229d4cb6ed1ddebbf2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 08bc7ed870fa492396c4489d4b37f0b5 Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1020989774", "metadata": {"Type": "work"}}} Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: Jul 28 18:02:07.177223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1020989774', 'metadata': {'Type': 'work'}}}} Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise error Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:07.178107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 18:02:07.179509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 18:02:07.180645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 18:02:07.180645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.180645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-757b5ecd-f8ec-46b6-ad1f-af2f494254da tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:07.186151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-757b5ecd-f8ec-46b6-ad1f-af2f494254da tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.047601 Jul 28 18:02:07.187177 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 27/44] 10.222.0.85 () {60 vars in 1156 bytes} [Thu Jul 28 18:02:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1050 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:02:07.192136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e314cab7-4dea-4b5a-9734-fa4e8c094fd7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:07.198005 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e314cab7-4dea-4b5a-9734-fa4e8c094fd7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:07.352496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e314cab7-4dea-4b5a-9734-fa4e8c094fd7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:07.391458 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e314cab7-4dea-4b5a-9734-fa4e8c094fd7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1215 microversion: 2.1 time: 0.202917 Jul 28 18:02:07.395877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 28/45] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:07 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:07.406080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cdf2a581-8f73-4522-8797-369e1a7bccfb tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Action: 'create', calling method: .version_select at 0x7fdae078cb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2019781872", "metadata": {"Type": "work"}}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cdf2a581-8f73-4522-8797-369e1a7bccfb tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Request method failure captured: Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 120 Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8d-jEATVF7C4G-cLqmkK-PPk-A-8jEB5LlHKeS9jftSvTeyFl4rqT_MNQ10PRGcX0xejtRkLF0Y0myuzip8B7BEr7UN8w2ZbvQ3TKTU10nrBbQPaO-BE6bpIuYpLJ3kAnoWIplgXgdOvt4iz2aO8mdICQ4z47LQhZOMIXvycwwBdM Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:02:07.458885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8f3bb1d4e49c4c229d4cb6ed1ddebbf2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 08bc7ed870fa492396c4489d4b37f0b5 Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2019781872", "metadata": {"Type": "work"}}} Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: Jul 28 18:02:07.460396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2019781872', 'metadata': {'Type': 'work'}}}} Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise error Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi '0' Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:07.461299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 18:02:07.464787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 18:02:07.466036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 18:02:07.466036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:07.466036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cdf2a581-8f73-4522-8797-369e1a7bccfb tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:07.470086 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cdf2a581-8f73-4522-8797-369e1a7bccfb tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.069207 Jul 28 18:02:07.475007 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 29/46] 10.222.0.85 () {60 vars in 1156 bytes} [Thu Jul 28 18:02:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 77 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:02:07.889020 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Flavor limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:02:07.889482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Image limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:02:07.889924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Flavor pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:02:07.890341 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Image pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:02:07.890855 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:02:07.909117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:07.909576 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:07.911700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:07.911700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:07.984863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Getting quotas for project c1c1587cf20d427e8bb03ffae1b1ce33. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:02:08.023312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Getting quotas for user 564e0f9000a1448ea9ea37a2892e6495 and project c1c1587cf20d427e8bb03ffae1b1ce33. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:02:08.070989 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0ada596b-9ef4-46d0-8097-6e7a7792d1f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'create', calling method: .version_select at 0x7fdae07b45e0>, body: {"keypair": {"name": "tempest-keypair-1288542214", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNxxSkFpxrMxS3WMZXI1kk5mRUBCxG2wq7fGJo+QmC9/7xDgZZbXxNaQoXXc1tm1QKwR77gvn4iMYxnqisTcjRS5f8WtqTo6/ZBrCKObSnNtH2XOjanN3ivQ2OROi+GQg=="}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:08.083035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Going to run 1 instances... {{(pid=130401) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:02:08.090490 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:02:08.112947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-0ada596b-9ef4-46d0-8097-6e7a7792d1f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Getting quotas for project 2732f627abb44936bedd3293898b24f3. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:02:08.122233 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-0ada596b-9ef4-46d0-8097-6e7a7792d1f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Getting quotas for user f740005b7fc245919a6ddbf61ee9ba85 and project 2732f627abb44936bedd3293898b24f3. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:02:08.287069 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7bbbe4b6-07e6-4c09-9eb1-eea23143d250 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.452055 Jul 28 18:02:08.292446 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 18/47] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:02:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:02:08.301861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3aec3234-b014-431d-a9a9-b838cba1cc59 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Action: 'create', calling method: .version_select at 0x7fdae078b9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1956644018", "metadata": {"Type": "work"}}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3aec3234-b014-431d-a9a9-b838cba1cc59 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Request method failure captured: Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 119 Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8d-jEATVF7C4G-cLqmkK-PPk-A-8jEB5LlHKeS9jftSvTeyFl4rqT_MNQ10PRGcX0xejtRkLF0Y0myuzip8B7BEr7UN8w2ZbvQ3TKTU10nrBbQPaO-BE6bpIuYpLJ3kAnoWIplgXgdOvt4iz2aO8mdICQ4z47LQhZOMIXvycwwBdM Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:02:08.312763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8f3bb1d4e49c4c229d4cb6ed1ddebbf2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 08bc7ed870fa492396c4489d4b37f0b5 Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1956644018", "metadata": {"Type": "work"}}} Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: Jul 28 18:02:08.314096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1956644018', 'metadata': {'Type': 'work'}}}} Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise error Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi '' Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:08.314999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 18:02:08.316590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 18:02:08.318460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 18:02:08.318460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.318460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3aec3234-b014-431d-a9a9-b838cba1cc59 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:08.318460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3aec3234-b014-431d-a9a9-b838cba1cc59 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022941 Jul 28 18:02:08.322591 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 19/48] 10.222.0.85 () {60 vars in 1156 bytes} [Thu Jul 28 18:02:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:02:08.327656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0ada596b-9ef4-46d0-8097-6e7a7792d1f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.850746 Jul 28 18:02:08.328271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 30/49] 10.222.0.85 () {62 vars in 1200 bytes} [Thu Jul 28 18:02:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 852 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 18:02:08.329869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4c38a500-4613-4d65-9e6b-d6c2f80ffa71 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:08.330601 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4c38a500-4613-4d65-9e6b-d6c2f80ffa71 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:08.334193 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1d35171b-4f7a-42d0-92fb-b5ede5d8343f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Calling method '.version_select at 0x7fdae078c310>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:08.425001 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-1d35171b-4f7a-42d0-92fb-b5ede5d8343f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] HTTP exception thrown: Volume tempest-invalid-1598454289 could not be found. Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1d35171b-4f7a-42d0-92fb-b5ede5d8343f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Request method failure captured: Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1598454289 HTTP/1.1 Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8d-jEATVF7C4G-cLqmkK-PPk-A-8jEB5LlHKeS9jftSvTeyFl4rqT_MNQ10PRGcX0xejtRkLF0Y0myuzip8B7BEr7UN8w2ZbvQ3TKTU10nrBbQPaO-BE6bpIuYpLJ3kAnoWIplgXgdOvt4iz2aO8mdICQ4z47LQhZOMIXvycwwBdM Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:02:08.427168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8f3bb1d4e49c4c229d4cb6ed1ddebbf2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 08bc7ed870fa492396c4489d4b37f0b5 Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Volume tempest-invalid-1598454289 could not be found. Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': 'tempest-invalid-1598454289'} Jul 28 18:02:08.428571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1598454289 could not be found. (HTTP 404) (Request-ID: req-c39ada2f-6ad4-4bc8-9eed-85dd97b08824) Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.429448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:02:08.430580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1598454289 could not be found. Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:02:08.431740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1598454289 could not be found. Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1598454289 could not be found. Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1d35171b-4f7a-42d0-92fb-b5ede5d8343f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Returning 404 to user: Volume tempest-invalid-1598454289 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1d35171b-4f7a-42d0-92fb-b5ede5d8343f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1598454289" status: 404 len: 99 microversion: 2.1 time: 0.099150 Jul 28 18:02:08.433520 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 31/50] 10.222.0.85 () {58 vars in 1218 bytes} [Thu Jul 28 18:02:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1598454289 => generated 99 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 28 18:02:08.442433 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-03d0b241-bb50-4e55-9b7d-88fe870253d0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:08.443106 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-03d0b241-bb50-4e55-9b7d-88fe870253d0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:08.533307 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4c38a500-4613-4d65-9e6b-d6c2f80ffa71 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:08.548044 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4c38a500-4613-4d65-9e6b-d6c2f80ffa71 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1221 microversion: 2.1 time: 0.223529 Jul 28 18:02:08.562021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-03d0b241-bb50-4e55-9b7d-88fe870253d0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:08.570123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-03d0b241-bb50-4e55-9b7d-88fe870253d0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1215 microversion: 2.1 time: 0.135469 Jul 28 18:02:08.570745 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 20/51] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:08 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1221 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:08.574387 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 32/52] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:08 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:08.592884 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6a64a5a1-6865-4343-8aea-fddeabbd89d9 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020771 Jul 28 18:02:08.594494 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 21/53] 10.222.0.85 () {58 vars in 1140 bytes} [Thu Jul 28 18:02:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 23 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 18:02:08.604896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fb2d1a9f-680c-4eb3-bab4-cc2b48061935 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003979 Jul 28 18:02:08.610037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 33/54] 10.222.0.85 () {58 vars in 1137 bytes} [Thu Jul 28 18:02:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 18:02:08.616225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0d30749e-e7e7-460f-986d-a59721633e4f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Calling method '.version_select at 0x7fdae078be50>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:08.660696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-0d30749e-e7e7-460f-986d-a59721633e4f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] HTTP exception thrown: Volume 7ffa9fad-3255-43b6-991d-7f1ba705dd73 could not be found. Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0d30749e-e7e7-460f-986d-a59721633e4f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Request method failure captured: Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/os-volumes/7ffa9fad-3255-43b6-991d-7f1ba705dd73 HTTP/1.1 Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8d-jEATVF7C4G-cLqmkK-PPk-A-8jEB5LlHKeS9jftSvTeyFl4rqT_MNQ10PRGcX0xejtRkLF0Y0myuzip8B7BEr7UN8w2ZbvQ3TKTU10nrBbQPaO-BE6bpIuYpLJ3kAnoWIplgXgdOvt4iz2aO8mdICQ4z47LQhZOMIXvycwwBdM Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:02:08.664833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8f3bb1d4e49c4c229d4cb6ed1ddebbf2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 08bc7ed870fa492396c4489d4b37f0b5 Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Volume 7ffa9fad-3255-43b6-991d-7f1ba705dd73 could not be found. Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '7ffa9fad-3255-43b6-991d-7f1ba705dd73'} Jul 28 18:02:08.669434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7ffa9fad-3255-43b6-991d-7f1ba705dd73 could not be found. (HTTP 404) (Request-ID: req-4b5ef1bf-f86a-40e2-9b08-7381d015db46) Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.670323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 18:02:08.672912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7ffa9fad-3255-43b6-991d-7f1ba705dd73 could not be found. Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 18:02:08.674097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7ffa9fad-3255-43b6-991d-7f1ba705dd73 could not be found. Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7ffa9fad-3255-43b6-991d-7f1ba705dd73 could not be found. Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0d30749e-e7e7-460f-986d-a59721633e4f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Returning 404 to user: Volume 7ffa9fad-3255-43b6-991d-7f1ba705dd73 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0d30749e-e7e7-460f-986d-a59721633e4f tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/7ffa9fad-3255-43b6-991d-7f1ba705dd73" status: 404 len: 109 microversion: 2.1 time: 0.056866 Jul 28 18:02:08.676224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 22/55] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:02:08 2022] DELETE /compute/v2.1/os-volumes/7ffa9fad-3255-43b6-991d-7f1ba705dd73 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:08.680040 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-180715c9-2144-43d8-982d-3a6b2f8997c6 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Calling method '.version_select at 0x7fdae078c310>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:08.786059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-180715c9-2144-43d8-982d-3a6b2f8997c6 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] HTTP exception thrown: Volume 66a828ba-79de-437d-b391-a4ceadf1c142 could not be found. Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-180715c9-2144-43d8-982d-3a6b2f8997c6 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Request method failure captured: Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/os-volumes/66a828ba-79de-437d-b391-a4ceadf1c142 HTTP/1.1 Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8d-jEATVF7C4G-cLqmkK-PPk-A-8jEB5LlHKeS9jftSvTeyFl4rqT_MNQ10PRGcX0xejtRkLF0Y0myuzip8B7BEr7UN8w2ZbvQ3TKTU10nrBbQPaO-BE6bpIuYpLJ3kAnoWIplgXgdOvt4iz2aO8mdICQ4z47LQhZOMIXvycwwBdM Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:02:08.788061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8f3bb1d4e49c4c229d4cb6ed1ddebbf2", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8f3bb1d4e49c4c229d4cb6ed1ddebbf2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 8f3bb1d4e49c4c229d4cb6ed1ddebbf2 Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesNegativeTest-668290903 Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 08bc7ed870fa492396c4489d4b37f0b5 Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesNegativeTest-668290903-project Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Volume 66a828ba-79de-437d-b391-a4ceadf1c142 could not be found. Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '66a828ba-79de-437d-b391-a4ceadf1c142'} Jul 28 18:02:08.789199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66a828ba-79de-437d-b391-a4ceadf1c142 could not be found. (HTTP 404) (Request-ID: req-c086de9e-7f3a-46bd-a161-192acb64813d) Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.789899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 18:02:08.790879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66a828ba-79de-437d-b391-a4ceadf1c142 could not be found. Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 18:02:08.792366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66a828ba-79de-437d-b391-a4ceadf1c142 could not be found. Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66a828ba-79de-437d-b391-a4ceadf1c142 could not be found. Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-180715c9-2144-43d8-982d-3a6b2f8997c6 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] Returning 404 to user: Volume 66a828ba-79de-437d-b391-a4ceadf1c142 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-180715c9-2144-43d8-982d-3a6b2f8997c6 tempest-VolumesNegativeTest-668290903 tempest-VolumesNegativeTest-668290903-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/66a828ba-79de-437d-b391-a4ceadf1c142" status: 404 len: 109 microversion: 2.1 time: 0.113726 Jul 28 18:02:08.793519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 34/56] 10.222.0.85 () {58 vars in 1245 bytes} [Thu Jul 28 18:02:08 2022] GET /compute/v2.1/os-volumes/66a828ba-79de-437d-b391-a4ceadf1c142 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:02:09.574214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5506a711-7c86-4800-8cb8-953b1f02072e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:09.574925 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5506a711-7c86-4800-8cb8-953b1f02072e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:09.595727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-67ed4ff7-ec9e-495b-9ce5-ab8b0265578e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:09.596981 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-67ed4ff7-ec9e-495b-9ce5-ab8b0265578e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:09.618505 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67ed4ff7-ec9e-495b-9ce5-ab8b0265578e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:09.619299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67ed4ff7-ec9e-495b-9ce5-ab8b0265578e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:09.620081 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67ed4ff7-ec9e-495b-9ce5-ab8b0265578e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:09.620523 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67ed4ff7-ec9e-495b-9ce5-ab8b0265578e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:09.642926 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5506a711-7c86-4800-8cb8-953b1f02072e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:09.649999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5506a711-7c86-4800-8cb8-953b1f02072e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1221 microversion: 2.1 time: 0.080433 Jul 28 18:02:09.654905 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 23/57] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:09 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:09.833858 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-67ed4ff7-ec9e-495b-9ce5-ab8b0265578e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:09.854696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-67ed4ff7-ec9e-495b-9ce5-ab8b0265578e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1219 microversion: 2.1 time: 0.262661 Jul 28 18:02:09.886809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 35/58] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:09 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1219 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:10.674769 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-171f1651-6a1f-4ddb-9ee0-4c8db5530d43 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:10.675395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-171f1651-6a1f-4ddb-9ee0-4c8db5530d43 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:10.685241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-171f1651-6a1f-4ddb-9ee0-4c8db5530d43 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:10.685898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-171f1651-6a1f-4ddb-9ee0-4c8db5530d43 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:10.686966 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-171f1651-6a1f-4ddb-9ee0-4c8db5530d43 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:10.687632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-171f1651-6a1f-4ddb-9ee0-4c8db5530d43 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:10.878818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1ec576b2-e4c4-4626-bbe6-a4a0909db783 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:10.879644 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1ec576b2-e4c4-4626-bbe6-a4a0909db783 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:10.896426 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ec576b2-e4c4-4626-bbe6-a4a0909db783 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:10.896888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ec576b2-e4c4-4626-bbe6-a4a0909db783 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:10.897679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ec576b2-e4c4-4626-bbe6-a4a0909db783 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:10.916859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ec576b2-e4c4-4626-bbe6-a4a0909db783 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:11.099042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-171f1651-6a1f-4ddb-9ee0-4c8db5530d43 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:11.133645 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-171f1651-6a1f-4ddb-9ee0-4c8db5530d43 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1225 microversion: 2.1 time: 0.465658 Jul 28 18:02:11.134234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 24/59] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:10 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1225 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:11.200994 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1ec576b2-e4c4-4626-bbe6-a4a0909db783 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:11.210916 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1ec576b2-e4c4-4626-bbe6-a4a0909db783 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1267 microversion: 2.1 time: 0.336449 Jul 28 18:02:11.230841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 36/60] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:10 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1267 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:12.172425 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4d7d9d12-cdbf-48f5-8c68-a168409cca35 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:12.173266 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4d7d9d12-cdbf-48f5-8c68-a168409cca35 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:12.196627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d7d9d12-cdbf-48f5-8c68-a168409cca35 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:12.197235 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d7d9d12-cdbf-48f5-8c68-a168409cca35 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:12.205791 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d7d9d12-cdbf-48f5-8c68-a168409cca35 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:12.208781 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d7d9d12-cdbf-48f5-8c68-a168409cca35 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:12.234861 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-04fd4488-a65b-485c-9515-7d50ffae85f4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:12.235633 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-04fd4488-a65b-485c-9515-7d50ffae85f4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:12.246078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04fd4488-a65b-485c-9515-7d50ffae85f4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:12.246559 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04fd4488-a65b-485c-9515-7d50ffae85f4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:12.247334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04fd4488-a65b-485c-9515-7d50ffae85f4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:12.247850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04fd4488-a65b-485c-9515-7d50ffae85f4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:12.616649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-04fd4488-a65b-485c-9515-7d50ffae85f4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:12.637904 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4d7d9d12-cdbf-48f5-8c68-a168409cca35 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:12.645500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4d7d9d12-cdbf-48f5-8c68-a168409cca35 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1273 microversion: 2.1 time: 0.485008 Jul 28 18:02:12.648191 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 25/61] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:12 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1273 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:12.660991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-04fd4488-a65b-485c-9515-7d50ffae85f4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1275 microversion: 2.1 time: 0.427899 Jul 28 18:02:12.680084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 37/62] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:12 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1275 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:13.670178 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-30305d58-034c-45f7-904b-dc1f49c6dca8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:13.670917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-30305d58-034c-45f7-904b-dc1f49c6dca8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:13.679374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-30305d58-034c-45f7-904b-dc1f49c6dca8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:13.679827 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-30305d58-034c-45f7-904b-dc1f49c6dca8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:13.680595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-30305d58-034c-45f7-904b-dc1f49c6dca8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:13.685101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-30305d58-034c-45f7-904b-dc1f49c6dca8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:13.688496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-851a5512-0fd0-48c9-8759-c15d0ec3ca99 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:13.691316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-851a5512-0fd0-48c9-8759-c15d0ec3ca99 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:13.723707 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-851a5512-0fd0-48c9-8759-c15d0ec3ca99 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:13.724408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-851a5512-0fd0-48c9-8759-c15d0ec3ca99 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:13.725255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-851a5512-0fd0-48c9-8759-c15d0ec3ca99 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:13.725706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-851a5512-0fd0-48c9-8759-c15d0ec3ca99 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:13.877806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-30305d58-034c-45f7-904b-dc1f49c6dca8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:13.891892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-30305d58-034c-45f7-904b-dc1f49c6dca8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1279 microversion: 2.1 time: 0.220002 Jul 28 18:02:13.892649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 26/63] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:13 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:13.975274 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-851a5512-0fd0-48c9-8759-c15d0ec3ca99 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:13.985336 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-851a5512-0fd0-48c9-8759-c15d0ec3ca99 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1273 microversion: 2.1 time: 0.300774 Jul 28 18:02:14.002651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 38/64] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:13 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:14.579453 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-105890519", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "144cc463-6995-43c7-bdb8-22e214402d26"}], "security_groups": [{"name": "tempest-securitygroup--531641434"}], "key_name": "tempest-keypair-1288542214", "user_data": "}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:14.921134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ab3c11b7-0e35-42b3-9dc5-837b57f84609 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:14.922091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ab3c11b7-0e35-42b3-9dc5-837b57f84609 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:14.942620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab3c11b7-0e35-42b3-9dc5-837b57f84609 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:14.944265 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab3c11b7-0e35-42b3-9dc5-837b57f84609 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:14.947509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab3c11b7-0e35-42b3-9dc5-837b57f84609 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:14.951920 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab3c11b7-0e35-42b3-9dc5-837b57f84609 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:15.082697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.network.neutron [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] validate_networks() for [('144cc463-6995-43c7-bdb8-22e214402d26', None, None, None, None, None)] {{(pid=130401) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:02:15.328768 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:15.369847 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ab3c11b7-0e35-42b3-9dc5-837b57f84609 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:15.382390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ab3c11b7-0e35-42b3-9dc5-837b57f84609 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.469201 Jul 28 18:02:15.382990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 39/65] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:14 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:15.389506 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-22bc6639-eec2-4024-a5b8-0c41eb4ebaf0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:15.391708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-22bc6639-eec2-4024-a5b8-0c41eb4ebaf0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:15.421243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-22bc6639-eec2-4024-a5b8-0c41eb4ebaf0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:15.424939 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-22bc6639-eec2-4024-a5b8-0c41eb4ebaf0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:15.441295 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-22bc6639-eec2-4024-a5b8-0c41eb4ebaf0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:15.442455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-22bc6639-eec2-4024-a5b8-0c41eb4ebaf0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:15.875574 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-22bc6639-eec2-4024-a5b8-0c41eb4ebaf0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:15.883852 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-22bc6639-eec2-4024-a5b8-0c41eb4ebaf0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.498114 Jul 28 18:02:15.902201 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 40/66] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:15 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:16.411832 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-80017461-f4c3-47d4-9743-21fb4ae89438 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:16.412530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-80017461-f4c3-47d4-9743-21fb4ae89438 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:16.423854 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-80017461-f4c3-47d4-9743-21fb4ae89438 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:16.424622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-80017461-f4c3-47d4-9743-21fb4ae89438 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:16.425646 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-80017461-f4c3-47d4-9743-21fb4ae89438 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:16.426299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-80017461-f4c3-47d4-9743-21fb4ae89438 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:16.516173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Flavor limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:02:16.519885 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Image limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:02:16.534669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Flavor pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:02:16.534669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Image pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:02:16.534669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:02:16.555947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:16.559147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:16.563354 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:16.563354 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:16.611196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Getting quotas for project 2732f627abb44936bedd3293898b24f3. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:02:16.620124 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Getting quotas for user f740005b7fc245919a6ddbf61ee9ba85 and project 2732f627abb44936bedd3293898b24f3. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:02:16.636246 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Going to run 1 instances... {{(pid=130401) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:02:16.639139 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:02:16.839850 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-53373397-3e22-4078-b6b1-6c1053cfddc5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.264181 Jul 28 18:02:16.847120 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 27/67] 10.222.0.85 () {62 vars in 1188 bytes} [Thu Jul 28 18:02:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2274 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 18:02:16.883792 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e29d8f34-0482-48cf-8f16-bbbf5a5c2f4a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:16.894145 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e29d8f34-0482-48cf-8f16-bbbf5a5c2f4a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:17.063518 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e29d8f34-0482-48cf-8f16-bbbf5a5c2f4a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:17.097688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e29d8f34-0482-48cf-8f16-bbbf5a5c2f4a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:17.097688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e29d8f34-0482-48cf-8f16-bbbf5a5c2f4a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:17.097688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e29d8f34-0482-48cf-8f16-bbbf5a5c2f4a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1281 microversion: 2.20 time: 0.236472 Jul 28 18:02:17.097946 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 28/68] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:16 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1281 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:17.121160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7df52949-e423-4c25-935e-983a54cc0477 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:17.125513 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7df52949-e423-4c25-935e-983a54cc0477 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:17.153863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7df52949-e423-4c25-935e-983a54cc0477 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:17.155159 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7df52949-e423-4c25-935e-983a54cc0477 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:17.158195 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7df52949-e423-4c25-935e-983a54cc0477 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:17.158742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7df52949-e423-4c25-935e-983a54cc0477 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:17.367980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-80017461-f4c3-47d4-9743-21fb4ae89438 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:17.376943 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-80017461-f4c3-47d4-9743-21fb4ae89438 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.972684 Jul 28 18:02:17.377581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 41/69] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:16 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:17.773916 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7df52949-e423-4c25-935e-983a54cc0477 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:17.804090 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7df52949-e423-4c25-935e-983a54cc0477 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.701155 Jul 28 18:02:17.804688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 29/70] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:17 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:18.123481 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8e0b3954-3723-4187-942c-5ecb038cbf99 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:18.124851 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8e0b3954-3723-4187-942c-5ecb038cbf99 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:18.311810 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8e0b3954-3723-4187-942c-5ecb038cbf99 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:18.328186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8e0b3954-3723-4187-942c-5ecb038cbf99 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:18.330065 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8e0b3954-3723-4187-942c-5ecb038cbf99 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:18.335205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8e0b3954-3723-4187-942c-5ecb038cbf99 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1281 microversion: 2.20 time: 0.219630 Jul 28 18:02:18.350377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 42/71] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:18 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1281 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:18.402526 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-18924741-9b1f-4589-a22e-60b2943c600b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:18.403202 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-18924741-9b1f-4589-a22e-60b2943c600b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:18.411055 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-18924741-9b1f-4589-a22e-60b2943c600b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:18.411569 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-18924741-9b1f-4589-a22e-60b2943c600b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:18.412378 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-18924741-9b1f-4589-a22e-60b2943c600b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:18.413064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-18924741-9b1f-4589-a22e-60b2943c600b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:18.833857 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-813aae34-f340-4083-9dd9-43c23bc6f908 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:18.834881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-813aae34-f340-4083-9dd9-43c23bc6f908 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:18.863020 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-813aae34-f340-4083-9dd9-43c23bc6f908 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:18.864956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-813aae34-f340-4083-9dd9-43c23bc6f908 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:18.866016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-813aae34-f340-4083-9dd9-43c23bc6f908 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:18.868652 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-813aae34-f340-4083-9dd9-43c23bc6f908 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:18.941783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-18924741-9b1f-4589-a22e-60b2943c600b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:18.953124 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-18924741-9b1f-4589-a22e-60b2943c600b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.557261 Jul 28 18:02:18.969563 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 30/72] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:18 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:19.601276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-ef9b7010-5f5a-4cfd-a5b7-85f6ad332447 req-8f3106ab-8805-4304-ad38-795fa5f1b30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e41bcb8c-0edb-453b-8954-2a2a9378a044", "tag": "56261dcb-db43-4b4f-884d-1f476a35889b"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:19.650777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-ef9b7010-5f5a-4cfd-a5b7-85f6ad332447 req-8f3106ab-8805-4304-ad38-795fa5f1b30b service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:19.650777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-ef9b7010-5f5a-4cfd-a5b7-85f6ad332447 req-8f3106ab-8805-4304-ad38-795fa5f1b30b service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:19.691217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-813aae34-f340-4083-9dd9-43c23bc6f908 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:19.729814 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-813aae34-f340-4083-9dd9-43c23bc6f908 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.900428 Jul 28 18:02:19.738180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 43/73] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:18 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:19.749597 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:19.750532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:19.756993 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-ef9b7010-5f5a-4cfd-a5b7-85f6ad332447 req-8f3106ab-8805-4304-ad38-795fa5f1b30b service nova] Creating event network-changed:56261dcb-db43-4b4f-884d-1f476a35889b for instance e41bcb8c-0edb-453b-8954-2a2a9378a044 on hv-cinder-83754 Jul 28 18:02:19.757629 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-ef9b7010-5f5a-4cfd-a5b7-85f6ad332447 req-8f3106ab-8805-4304-ad38-795fa5f1b30b service nova] Acquired lock "compute-rpcapi-router" {{(pid=130401) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 18:02:19.760586 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfd721b5-ef2b-4f80-a005-5b06d2c7c622 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:19.761934 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfd721b5-ef2b-4f80-a005-5b06d2c7c622 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:19.777289 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfd721b5-ef2b-4f80-a005-5b06d2c7c622 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:19.777390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:19.777482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfd721b5-ef2b-4f80-a005-5b06d2c7c622 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:19.778641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:19.782249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:19.783326 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:19.797524 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.compute.rpcapi [None req-dfd721b5-ef2b-4f80-a005-5b06d2c7c622 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 18:02:19.799677 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfd721b5-ef2b-4f80-a005-5b06d2c7c622 None None] Releasing lock "compute-rpcapi-router" {{(pid=130401) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 18:02:19.847992 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-dfd721b5-ef2b-4f80-a005-5b06d2c7c622 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502390 Jul 28 18:02:19.849905 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 31/74] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:20.262684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-02a80b29-321f-4fca-b7e6-0bd23d3105fa req-119746e2-489f-4cb1-ba15-05f135377bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e09c2f70-20f1-4762-b7ea-36d9ef650f15", "tag": "66e48c64-aab6-4386-8f4e-c36d3e4b5fc0"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:20.302448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:20.302448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:20.303103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-02a80b29-321f-4fca-b7e6-0bd23d3105fa req-119746e2-489f-4cb1-ba15-05f135377bdc service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:20.303103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-02a80b29-321f-4fca-b7e6-0bd23d3105fa req-119746e2-489f-4cb1-ba15-05f135377bdc service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:20.308073 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:20.311820 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ae4ed784-2bdd-4ccd-88fc-c3cfc531ea63 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1277 microversion: 2.20 time: 0.571789 Jul 28 18:02:20.312452 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 44/75] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:19 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1277 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:20.343160 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-05da24da-814d-47fe-81cd-71ff19e70601 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:20.344040 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-05da24da-814d-47fe-81cd-71ff19e70601 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:20.354987 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-05da24da-814d-47fe-81cd-71ff19e70601 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:20.354987 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-05da24da-814d-47fe-81cd-71ff19e70601 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:20.354987 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-05da24da-814d-47fe-81cd-71ff19e70601 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:20.355345 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-05da24da-814d-47fe-81cd-71ff19e70601 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:20.356442 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-02a80b29-321f-4fca-b7e6-0bd23d3105fa req-119746e2-489f-4cb1-ba15-05f135377bdc service nova] Creating event network-changed:66e48c64-aab6-4386-8f4e-c36d3e4b5fc0 for instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 on hv-cinder-83754 Jul 28 18:02:20.362705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-02a80b29-321f-4fca-b7e6-0bd23d3105fa req-119746e2-489f-4cb1-ba15-05f135377bdc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.511184 Jul 28 18:02:20.363602 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 32/76] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:20.772688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7b82775c-ead9-4c52-ad0a-eaec3e2d817f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:20.773831 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7b82775c-ead9-4c52-ad0a-eaec3e2d817f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:20.806755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7b82775c-ead9-4c52-ad0a-eaec3e2d817f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:20.806755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7b82775c-ead9-4c52-ad0a-eaec3e2d817f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:20.806755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7b82775c-ead9-4c52-ad0a-eaec3e2d817f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:20.807384 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7b82775c-ead9-4c52-ad0a-eaec3e2d817f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:21.099491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-05da24da-814d-47fe-81cd-71ff19e70601 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:21.109342 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-05da24da-814d-47fe-81cd-71ff19e70601 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.792126 Jul 28 18:02:21.110259 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 45/77] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:20 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:21.346735 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:21.347609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:21.359491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:21.360344 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:21.365135 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:21.365813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:21.421373 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7b82775c-ead9-4c52-ad0a-eaec3e2d817f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:21.431992 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7b82775c-ead9-4c52-ad0a-eaec3e2d817f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.663088 Jul 28 18:02:21.437477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 33/78] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:20 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:21.469034 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:21.496081 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:21.502832 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:21.502832 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7c779025-3c9f-4892-aaa5-542b2df662e2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1333 microversion: 2.20 time: 0.156946 Jul 28 18:02:21.502832 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 46/79] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:21 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1333 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:22.139918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1ced99b8-c5b5-4aff-8e78-adb264fbf210 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:22.141333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1ced99b8-c5b5-4aff-8e78-adb264fbf210 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:22.158310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1ced99b8-c5b5-4aff-8e78-adb264fbf210 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.159319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1ced99b8-c5b5-4aff-8e78-adb264fbf210 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:22.160867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1ced99b8-c5b5-4aff-8e78-adb264fbf210 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.161544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1ced99b8-c5b5-4aff-8e78-adb264fbf210 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:22.465909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0fb7ca51-0bdc-467e-b31f-5def3cb2b0fd tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:22.467685 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0fb7ca51-0bdc-467e-b31f-5def3cb2b0fd tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:22.481634 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0fb7ca51-0bdc-467e-b31f-5def3cb2b0fd tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.532775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0fb7ca51-0bdc-467e-b31f-5def3cb2b0fd tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:22.537512 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0fb7ca51-0bdc-467e-b31f-5def3cb2b0fd tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.538510 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0fb7ca51-0bdc-467e-b31f-5def3cb2b0fd tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:22.689921 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1ced99b8-c5b5-4aff-8e78-adb264fbf210 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:22.710898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1ced99b8-c5b5-4aff-8e78-adb264fbf210 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.580457 Jul 28 18:02:22.712504 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 34/80] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:22 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:22.723063 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:22.723994 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:22.735154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.735154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:22.736371 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.737293 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:22.770892 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0fb7ca51-0bdc-467e-b31f-5def3cb2b0fd tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:22.780080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0fb7ca51-0bdc-467e-b31f-5def3cb2b0fd tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.320639 Jul 28 18:02:22.786871 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 47/81] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:22 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:22.845406 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-588b0c08-e6c4-4b39-b625-e2b243e4d0fd req-d8be8e6b-0ee2-4f50-b85c-7530ceb87cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c194fd9-27de-4620-ae13-0d988b2adf4d", "tag": "c5407d67-f752-4458-a306-d8d20e45c534"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:22.911812 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-588b0c08-e6c4-4b39-b625-e2b243e4d0fd req-d8be8e6b-0ee2-4f50-b85c-7530ceb87cf5 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.912318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-588b0c08-e6c4-4b39-b625-e2b243e4d0fd req-d8be8e6b-0ee2-4f50-b85c-7530ceb87cf5 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:22.981845 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-588b0c08-e6c4-4b39-b625-e2b243e4d0fd req-d8be8e6b-0ee2-4f50-b85c-7530ceb87cf5 service nova] Creating event network-changed:c5407d67-f752-4458-a306-d8d20e45c534 for instance 8c194fd9-27de-4620-ae13-0d988b2adf4d on hv-cinder-83754 Jul 28 18:02:22.984674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-588b0c08-e6c4-4b39-b625-e2b243e4d0fd req-d8be8e6b-0ee2-4f50-b85c-7530ceb87cf5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130400) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 18:02:22.985950 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-819dc1ef-612b-4855-9ec7-b09790f7eda3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.986427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-819dc1ef-612b-4855-9ec7-b09790f7eda3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:22.987237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-819dc1ef-612b-4855-9ec7-b09790f7eda3 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:22.987675 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-819dc1ef-612b-4855-9ec7-b09790f7eda3 None None] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:23.032473 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.compute.rpcapi [None req-819dc1ef-612b-4855-9ec7-b09790f7eda3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 18:02:23.039581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-819dc1ef-612b-4855-9ec7-b09790f7eda3 None None] Releasing lock "compute-rpcapi-router" {{(pid=130400) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 18:02:23.054083 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:23.085739 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:23.092968 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-819dc1ef-612b-4855-9ec7-b09790f7eda3 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303683 Jul 28 18:02:23.094078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 48/82] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:23.095058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:23.097476 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5d7cb583-b6c9-482d-b6d8-f9cb58e794da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1341 microversion: 2.20 time: 0.379618 Jul 28 18:02:23.101382 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 35/83] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:22 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1341 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:23.733401 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b24f18b3-7b64-4de1-9ba1-c06790b3c26e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:23.738320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b24f18b3-7b64-4de1-9ba1-c06790b3c26e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:23.741358 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b24f18b3-7b64-4de1-9ba1-c06790b3c26e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:23.741807 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b24f18b3-7b64-4de1-9ba1-c06790b3c26e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:23.742822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b24f18b3-7b64-4de1-9ba1-c06790b3c26e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:23.743619 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b24f18b3-7b64-4de1-9ba1-c06790b3c26e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:23.808488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-edb0a5ae-cb66-4fa1-8b37-a6519ece17a4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:23.809140 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-edb0a5ae-cb66-4fa1-8b37-a6519ece17a4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:23.815916 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-edb0a5ae-cb66-4fa1-8b37-a6519ece17a4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:23.818917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-edb0a5ae-cb66-4fa1-8b37-a6519ece17a4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:23.818917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-edb0a5ae-cb66-4fa1-8b37-a6519ece17a4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:23.818917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-edb0a5ae-cb66-4fa1-8b37-a6519ece17a4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:24.004871 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-edb0a5ae-cb66-4fa1-8b37-a6519ece17a4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:24.013232 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-edb0a5ae-cb66-4fa1-8b37-a6519ece17a4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.209916 Jul 28 18:02:24.014121 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 36/84] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:23 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:24.054460 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b24f18b3-7b64-4de1-9ba1-c06790b3c26e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:24.062543 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b24f18b3-7b64-4de1-9ba1-c06790b3c26e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.333419 Jul 28 18:02:24.065308 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 49/85] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:23 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:24.124738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:24.125654 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:24.131808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:24.135388 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:24.135388 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:24.135388 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:24.200802 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:24.208710 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:24.210221 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:24.211356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9acf76a1-7aa3-423a-953b-ebfa00ad67c9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1339 microversion: 2.20 time: 0.091697 Jul 28 18:02:24.214656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 37/86] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:24 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1339 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:02:25.035064 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e335b476-d8e4-4b8f-8ec6-72eedb5aae45 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:25.036542 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e335b476-d8e4-4b8f-8ec6-72eedb5aae45 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:25.044339 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e335b476-d8e4-4b8f-8ec6-72eedb5aae45 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:25.044799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e335b476-d8e4-4b8f-8ec6-72eedb5aae45 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:25.045618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e335b476-d8e4-4b8f-8ec6-72eedb5aae45 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:25.046060 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e335b476-d8e4-4b8f-8ec6-72eedb5aae45 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:25.086225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b631c939-4f13-4982-aba2-54aaa97dd20f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:25.088079 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b631c939-4f13-4982-aba2-54aaa97dd20f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:25.097975 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b631c939-4f13-4982-aba2-54aaa97dd20f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:25.098535 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b631c939-4f13-4982-aba2-54aaa97dd20f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:25.099608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b631c939-4f13-4982-aba2-54aaa97dd20f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:25.100277 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b631c939-4f13-4982-aba2-54aaa97dd20f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:25.251837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e335b476-d8e4-4b8f-8ec6-72eedb5aae45 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:25.262438 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e335b476-d8e4-4b8f-8ec6-72eedb5aae45 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.230552 Jul 28 18:02:25.277968 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 50/87] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:25 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:25.284070 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:25.285147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:25.292988 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:25.294021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:25.295051 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:25.295677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:25.310805 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b631c939-4f13-4982-aba2-54aaa97dd20f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:25.338503 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b631c939-4f13-4982-aba2-54aaa97dd20f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.255093 Jul 28 18:02:25.341320 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 38/88] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:25 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:25.725311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:25.732603 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:25.734144 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:25.735329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-04c0a8e4-9553-42ff-932f-837044fdbfa0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.456077 Jul 28 18:02:25.737455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 51/89] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:25 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:26.284381 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a82a5198-3694-47c7-8ea2-62c21ff85a0e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:26.285101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a82a5198-3694-47c7-8ea2-62c21ff85a0e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:26.294697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a82a5198-3694-47c7-8ea2-62c21ff85a0e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:26.295199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a82a5198-3694-47c7-8ea2-62c21ff85a0e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:26.296439 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a82a5198-3694-47c7-8ea2-62c21ff85a0e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:26.296585 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a82a5198-3694-47c7-8ea2-62c21ff85a0e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:26.362031 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9e5762ab-6aeb-408a-9346-160c58dd038c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:26.362800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9e5762ab-6aeb-408a-9346-160c58dd038c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:26.377983 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9e5762ab-6aeb-408a-9346-160c58dd038c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:26.378687 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9e5762ab-6aeb-408a-9346-160c58dd038c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:26.379952 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9e5762ab-6aeb-408a-9346-160c58dd038c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:26.380445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9e5762ab-6aeb-408a-9346-160c58dd038c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:26.408691 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:26.512546 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a82a5198-3694-47c7-8ea2-62c21ff85a0e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:26.522922 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a82a5198-3694-47c7-8ea2-62c21ff85a0e tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.242658 Jul 28 18:02:26.525268 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 39/90] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:26 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:26.660194 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9e5762ab-6aeb-408a-9346-160c58dd038c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:26.664609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9e5762ab-6aeb-408a-9346-160c58dd038c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.307169 Jul 28 18:02:26.666437 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 52/91] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:26 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:26.779353 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:26.779353 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:26.802398 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:26.811053 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:26.811053 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:26.811053 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:27.043947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:27.056728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:27.058335 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:27.059767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5c110a8d-87ff-4b86-b45d-29039c5e5316 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.298395 Jul 28 18:02:27.060838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 40/92] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:26 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:27.545949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6bff993a-e479-46d6-8f7a-262ccfa9fb9f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:27.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6bff993a-e479-46d6-8f7a-262ccfa9fb9f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:27.554102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6bff993a-e479-46d6-8f7a-262ccfa9fb9f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:27.554595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6bff993a-e479-46d6-8f7a-262ccfa9fb9f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:27.556158 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6bff993a-e479-46d6-8f7a-262ccfa9fb9f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:27.556620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6bff993a-e479-46d6-8f7a-262ccfa9fb9f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:27.685779 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f7338de3-ad25-42e4-956d-faa9e2e60f5d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:27.686551 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f7338de3-ad25-42e4-956d-faa9e2e60f5d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:27.689339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=26 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:27.694973 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f7338de3-ad25-42e4-956d-faa9e2e60f5d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:27.699240 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f7338de3-ad25-42e4-956d-faa9e2e60f5d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:27.702962 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f7338de3-ad25-42e4-956d-faa9e2e60f5d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:27.703747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f7338de3-ad25-42e4-956d-faa9e2e60f5d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:27.846770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6bff993a-e479-46d6-8f7a-262ccfa9fb9f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:27.860279 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6bff993a-e479-46d6-8f7a-262ccfa9fb9f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.318310 Jul 28 18:02:27.874719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 53/93] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:27 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:27.995047 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f7338de3-ad25-42e4-956d-faa9e2e60f5d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:28.006549 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f7338de3-ad25-42e4-956d-faa9e2e60f5d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.321479 Jul 28 18:02:28.011578 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 41/94] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:27 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:28.089826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:28.092814 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:28.105231 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:28.105978 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:28.107621 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:28.110492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:28.316335 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=18 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:28.551524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:28.560609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:28.562315 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:28.563314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-62d0a089-e38f-4aff-ac2f-5d24ec9052b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.479124 Jul 28 18:02:28.563877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 54/95] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:28 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:28.730238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-b072bd9b-d14a-4baa-8ca2-fdd0bfacd8e2 req-4a18dc02-4f02-4794-bbd7-49ebf07a28be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f64c566-cf5d-4240-95e2-c5746a5bba89", "tag": "8980c8f3-7810-4b7b-b88d-1b866e291a34"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:28.743832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:28.746109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-b072bd9b-d14a-4baa-8ca2-fdd0bfacd8e2 req-4a18dc02-4f02-4794-bbd7-49ebf07a28be service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:28.746833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-b072bd9b-d14a-4baa-8ca2-fdd0bfacd8e2 req-4a18dc02-4f02-4794-bbd7-49ebf07a28be service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:28.766642 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-b072bd9b-d14a-4baa-8ca2-fdd0bfacd8e2 req-4a18dc02-4f02-4794-bbd7-49ebf07a28be service nova] Creating event network-changed:8980c8f3-7810-4b7b-b88d-1b866e291a34 for instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 on hv-cinder-83754 Jul 28 18:02:28.776966 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-b072bd9b-d14a-4baa-8ca2-fdd0bfacd8e2 req-4a18dc02-4f02-4794-bbd7-49ebf07a28be service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051021 Jul 28 18:02:28.781575 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 42/96] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:28.881169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-62c9ffef-3e72-46af-aed4-96c5ca68a564 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:28.881822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-62c9ffef-3e72-46af-aed4-96c5ca68a564 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:28.889908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-62c9ffef-3e72-46af-aed4-96c5ca68a564 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:28.890368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-62c9ffef-3e72-46af-aed4-96c5ca68a564 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:28.893755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-62c9ffef-3e72-46af-aed4-96c5ca68a564 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:28.893755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-62c9ffef-3e72-46af-aed4-96c5ca68a564 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:29.029891 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-62c9ffef-3e72-46af-aed4-96c5ca68a564 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:29.035111 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-263b3b55-5075-445b-a50e-9cf0364da14e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:29.035811 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-263b3b55-5075-445b-a50e-9cf0364da14e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:29.038180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-62c9ffef-3e72-46af-aed4-96c5ca68a564 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.160840 Jul 28 18:02:29.038980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 55/97] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:28 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:29.044903 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-263b3b55-5075-445b-a50e-9cf0364da14e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:29.044903 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-263b3b55-5075-445b-a50e-9cf0364da14e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:29.044903 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-263b3b55-5075-445b-a50e-9cf0364da14e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:29.045331 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-263b3b55-5075-445b-a50e-9cf0364da14e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:29.049535 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:29.190092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-263b3b55-5075-445b-a50e-9cf0364da14e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:29.197825 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-263b3b55-5075-445b-a50e-9cf0364da14e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.167021 Jul 28 18:02:29.198625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 43/98] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:29 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:29.587629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:29.588235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:29.590257 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:29.595193 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:29.595635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:29.596386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:29.596813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:29.750098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:29.759440 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:29.760985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:29.762883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4efa7740-7d7e-4fc4-a964-6e10b3119416 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.180008 Jul 28 18:02:29.763749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 56/99] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:29 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:30.061423 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-dcf655ab-d6ea-4cbc-886f-45469d63ddc3 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:30.061990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-dcf655ab-d6ea-4cbc-886f-45469d63ddc3 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:30.063826 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=8 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:30.069316 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dcf655ab-d6ea-4cbc-886f-45469d63ddc3 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:30.072611 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dcf655ab-d6ea-4cbc-886f-45469d63ddc3 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:30.072611 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dcf655ab-d6ea-4cbc-886f-45469d63ddc3 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:30.072611 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dcf655ab-d6ea-4cbc-886f-45469d63ddc3 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:30.209824 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-dcf655ab-d6ea-4cbc-886f-45469d63ddc3 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:30.217059 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-dcf655ab-d6ea-4cbc-886f-45469d63ddc3 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.160198 Jul 28 18:02:30.217799 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 44/100] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:30 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:30.218844 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-648a9e48-d5b9-4a5f-a296-e9ade1c10f1e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:30.219487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-648a9e48-d5b9-4a5f-a296-e9ade1c10f1e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:30.225471 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-648a9e48-d5b9-4a5f-a296-e9ade1c10f1e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:30.225921 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-648a9e48-d5b9-4a5f-a296-e9ade1c10f1e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:30.226719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-648a9e48-d5b9-4a5f-a296-e9ade1c10f1e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:30.227216 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-648a9e48-d5b9-4a5f-a296-e9ade1c10f1e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:30.360152 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-648a9e48-d5b9-4a5f-a296-e9ade1c10f1e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:30.367540 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-648a9e48-d5b9-4a5f-a296-e9ade1c10f1e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.152677 Jul 28 18:02:30.368664 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 57/101] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:30 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:30.787439 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:30.788197 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:30.795305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:30.795758 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:30.796527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:30.797126 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:30.942435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:30.951042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:30.952553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:30.953659 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-24ba21bf-1aed-45c8-91a2-de6a003d93bb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.170770 Jul 28 18:02:30.958654 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 45/102] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:30 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:31.239017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8f451833-af94-413e-baa6-b95a4bd7093a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:31.240659 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8f451833-af94-413e-baa6-b95a4bd7093a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:31.247643 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f451833-af94-413e-baa6-b95a4bd7093a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:31.248089 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f451833-af94-413e-baa6-b95a4bd7093a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:31.248866 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f451833-af94-413e-baa6-b95a4bd7093a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:31.249297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f451833-af94-413e-baa6-b95a4bd7093a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:31.390002 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ce200061-9129-4b85-b08d-dd35d240f72c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:31.390647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ce200061-9129-4b85-b08d-dd35d240f72c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:31.397082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ce200061-9129-4b85-b08d-dd35d240f72c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:31.397777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ce200061-9129-4b85-b08d-dd35d240f72c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:31.398830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ce200061-9129-4b85-b08d-dd35d240f72c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:31.399987 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ce200061-9129-4b85-b08d-dd35d240f72c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:31.406957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8f451833-af94-413e-baa6-b95a4bd7093a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:31.415248 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8f451833-af94-413e-baa6-b95a4bd7093a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.179992 Jul 28 18:02:31.416586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 58/103] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:31 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:31.549456 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ce200061-9129-4b85-b08d-dd35d240f72c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:31.557947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ce200061-9129-4b85-b08d-dd35d240f72c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.172026 Jul 28 18:02:31.558540 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 46/104] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:31 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:31.981649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:31.981649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:31.984654 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:31.985187 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:31.985966 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:31.986446 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:32.135702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:32.144268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:32.145833 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:32.147268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4ecb0a48-9bc8-4185-a2ed-b7969455b05c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.173678 Jul 28 18:02:32.162563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 59/105] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:31 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:32.437498 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c9a26f65-6d61-41f6-972a-dec8785dacf7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:32.438114 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c9a26f65-6d61-41f6-972a-dec8785dacf7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:32.444100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c9a26f65-6d61-41f6-972a-dec8785dacf7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:32.444552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c9a26f65-6d61-41f6-972a-dec8785dacf7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:32.445325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c9a26f65-6d61-41f6-972a-dec8785dacf7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:32.445805 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c9a26f65-6d61-41f6-972a-dec8785dacf7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:32.583539 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3aad5ada-a4c1-4a17-ac2d-a5c1c26774a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:32.588557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3aad5ada-a4c1-4a17-ac2d-a5c1c26774a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:32.591649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3aad5ada-a4c1-4a17-ac2d-a5c1c26774a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:32.592166 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3aad5ada-a4c1-4a17-ac2d-a5c1c26774a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:32.593117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3aad5ada-a4c1-4a17-ac2d-a5c1c26774a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:32.593511 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c9a26f65-6d61-41f6-972a-dec8785dacf7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:32.593992 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3aad5ada-a4c1-4a17-ac2d-a5c1c26774a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:32.601367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c9a26f65-6d61-41f6-972a-dec8785dacf7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.168151 Jul 28 18:02:32.608650 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 47/106] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:32 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:32.739749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3aad5ada-a4c1-4a17-ac2d-a5c1c26774a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:32.748214 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3aad5ada-a4c1-4a17-ac2d-a5c1c26774a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.168566 Jul 28 18:02:32.748775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 60/107] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:32 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:33.172576 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:33.173136 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:33.179290 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:33.179743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:33.181098 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:33.181550 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:33.333417 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:33.342479 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:33.344255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:33.345739 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b7e4b837-2b73-42e7-9cbc-1a38f5fed006 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.177371 Jul 28 18:02:33.346709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 48/108] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:33 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:33.643776 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9d6b7a88-db91-4cd8-aa72-e04b4162d04b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:33.644922 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9d6b7a88-db91-4cd8-aa72-e04b4162d04b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:33.646807 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:33.651862 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d6b7a88-db91-4cd8-aa72-e04b4162d04b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:33.652312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d6b7a88-db91-4cd8-aa72-e04b4162d04b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:33.653112 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d6b7a88-db91-4cd8-aa72-e04b4162d04b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:33.653518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d6b7a88-db91-4cd8-aa72-e04b4162d04b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:33.769794 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bdd63104-7d18-4947-96d2-477517873223 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:33.770645 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bdd63104-7d18-4947-96d2-477517873223 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:33.777774 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bdd63104-7d18-4947-96d2-477517873223 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:33.778588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bdd63104-7d18-4947-96d2-477517873223 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:33.779192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bdd63104-7d18-4947-96d2-477517873223 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:33.779481 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bdd63104-7d18-4947-96d2-477517873223 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:33.837815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9d6b7a88-db91-4cd8-aa72-e04b4162d04b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:33.848286 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9d6b7a88-db91-4cd8-aa72-e04b4162d04b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.208259 Jul 28 18:02:33.848873 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 61/109] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:33 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:33.932066 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bdd63104-7d18-4947-96d2-477517873223 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:33.939727 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bdd63104-7d18-4947-96d2-477517873223 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.173858 Jul 28 18:02:33.940283 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 49/110] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:33 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:34.370545 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:34.371421 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:34.377544 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:34.377997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:34.378797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:34.379387 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:34.515331 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:34.523347 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:34.525624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:34.526770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f941c5ba-b7dc-47aa-bf6a-9105ac1ecb61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.161530 Jul 28 18:02:34.527360 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 62/111] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:34 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:34.869833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-06728160-3f96-4efb-8655-29056016822f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:34.873931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-06728160-3f96-4efb-8655-29056016822f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:34.877350 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-06728160-3f96-4efb-8655-29056016822f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:34.877798 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-06728160-3f96-4efb-8655-29056016822f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:34.878594 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-06728160-3f96-4efb-8655-29056016822f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:34.879029 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-06728160-3f96-4efb-8655-29056016822f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:34.961102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-561c8032-8e13-4f43-82af-4eedcc60f6f8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:34.962956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-561c8032-8e13-4f43-82af-4eedcc60f6f8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:34.969052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-561c8032-8e13-4f43-82af-4eedcc60f6f8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:34.969586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-561c8032-8e13-4f43-82af-4eedcc60f6f8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:34.970386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-561c8032-8e13-4f43-82af-4eedcc60f6f8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:34.970829 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-561c8032-8e13-4f43-82af-4eedcc60f6f8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:35.072130 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-06728160-3f96-4efb-8655-29056016822f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:35.080251 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-06728160-3f96-4efb-8655-29056016822f tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.214472 Jul 28 18:02:35.080855 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 50/112] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:34 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:35.106591 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-561c8032-8e13-4f43-82af-4eedcc60f6f8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:35.114205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-561c8032-8e13-4f43-82af-4eedcc60f6f8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.157003 Jul 28 18:02:35.114928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 63/113] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:34 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:35.557267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:35.557877 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:35.563992 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:35.564440 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:35.565204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:35.565643 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:35.700869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:35.708632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:35.710120 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:35.711302 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d2b38d42-2c34-4525-9114-228ce2df509c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.158597 Jul 28 18:02:35.711936 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 51/114] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:35 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:36.103898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-553527a4-23b8-4058-96b4-caf1e687c604 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:36.104528 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-553527a4-23b8-4058-96b4-caf1e687c604 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:36.110648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-553527a4-23b8-4058-96b4-caf1e687c604 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:36.111097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-553527a4-23b8-4058-96b4-caf1e687c604 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:36.111858 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-553527a4-23b8-4058-96b4-caf1e687c604 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:36.112288 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-553527a4-23b8-4058-96b4-caf1e687c604 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:36.135783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f1ba290c-5918-4815-8c62-b8fe916d68c3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:36.137018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f1ba290c-5918-4815-8c62-b8fe916d68c3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:36.144991 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f1ba290c-5918-4815-8c62-b8fe916d68c3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:36.145761 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f1ba290c-5918-4815-8c62-b8fe916d68c3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:36.146499 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f1ba290c-5918-4815-8c62-b8fe916d68c3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:36.155134 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f1ba290c-5918-4815-8c62-b8fe916d68c3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:36.255364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-553527a4-23b8-4058-96b4-caf1e687c604 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:36.263535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-553527a4-23b8-4058-96b4-caf1e687c604 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.164120 Jul 28 18:02:36.264103 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 64/115] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:36 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:36.308527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f1ba290c-5918-4815-8c62-b8fe916d68c3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:36.316638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f1ba290c-5918-4815-8c62-b8fe916d68c3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.185185 Jul 28 18:02:36.317503 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 52/116] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:36 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:36.733387 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:36.734079 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:36.740134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:36.740649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:36.741466 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:36.741893 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:36.882507 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:36.892083 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:36.895557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:36.895557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4283d0ff-1b2a-40f6-a382-fb56edb3aa72 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.165713 Jul 28 18:02:36.896555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 65/117] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:36 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:37.285358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4196b2f2-e093-4b97-a353-471c55f02db4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:37.285998 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4196b2f2-e093-4b97-a353-471c55f02db4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:37.293820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4196b2f2-e093-4b97-a353-471c55f02db4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:37.294926 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4196b2f2-e093-4b97-a353-471c55f02db4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:37.295934 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4196b2f2-e093-4b97-a353-471c55f02db4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:37.297663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4196b2f2-e093-4b97-a353-471c55f02db4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:37.340389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d5c5852f-ac9c-4ef7-a887-0ce3f2b7e58f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:37.341728 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d5c5852f-ac9c-4ef7-a887-0ce3f2b7e58f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:37.349390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5c5852f-ac9c-4ef7-a887-0ce3f2b7e58f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:37.352455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5c5852f-ac9c-4ef7-a887-0ce3f2b7e58f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:37.352455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5c5852f-ac9c-4ef7-a887-0ce3f2b7e58f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:37.352455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5c5852f-ac9c-4ef7-a887-0ce3f2b7e58f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:37.469273 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4196b2f2-e093-4b97-a353-471c55f02db4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:37.479851 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4196b2f2-e093-4b97-a353-471c55f02db4 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.198292 Jul 28 18:02:37.485604 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 53/118] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:37 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:37.733310 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d5c5852f-ac9c-4ef7-a887-0ce3f2b7e58f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:37.740966 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d5c5852f-ac9c-4ef7-a887-0ce3f2b7e58f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.406519 Jul 28 18:02:37.741606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 66/119] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:37 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:37.919515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:37.920133 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:37.927077 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:37.927392 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:37.928187 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:37.928641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:38.064655 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:38.075509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:38.083041 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:38.084595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-36a04824-8d34-49ac-b4ba-6b297c1ff0ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.169145 Jul 28 18:02:38.101021 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 54/120] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:37 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:38.515420 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c4d873b0-d7d9-4ffd-9abf-23c37dc1e246 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:38.516025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c4d873b0-d7d9-4ffd-9abf-23c37dc1e246 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:38.533364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c4d873b0-d7d9-4ffd-9abf-23c37dc1e246 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:38.534100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c4d873b0-d7d9-4ffd-9abf-23c37dc1e246 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:38.535210 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c4d873b0-d7d9-4ffd-9abf-23c37dc1e246 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:38.535799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c4d873b0-d7d9-4ffd-9abf-23c37dc1e246 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:38.764623 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cc2e5b87-3f24-4d66-91e0-e1959b1301a1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:38.765245 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cc2e5b87-3f24-4d66-91e0-e1959b1301a1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:38.773175 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc2e5b87-3f24-4d66-91e0-e1959b1301a1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:38.774182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc2e5b87-3f24-4d66-91e0-e1959b1301a1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:38.775754 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc2e5b87-3f24-4d66-91e0-e1959b1301a1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:38.776530 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc2e5b87-3f24-4d66-91e0-e1959b1301a1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:38.976747 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c4d873b0-d7d9-4ffd-9abf-23c37dc1e246 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:38.987330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c4d873b0-d7d9-4ffd-9abf-23c37dc1e246 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.475700 Jul 28 18:02:38.987920 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 67/121] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:38 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:39.054621 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-30e7b0d2-b180-4187-9958-f19991e598ed req-f193fbc7-b400-42ee-8716-09fb2531118b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09c2f70-20f1-4762-b7ea-36d9ef650f15", "name": "network-vif-plugged", "status": "completed", "tag": "66e48c64-aab6-4386-8f4e-c36d3e4b5fc0"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:39.065161 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-30e7b0d2-b180-4187-9958-f19991e598ed req-f193fbc7-b400-42ee-8716-09fb2531118b service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:39.065836 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-30e7b0d2-b180-4187-9958-f19991e598ed req-f193fbc7-b400-42ee-8716-09fb2531118b service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:39.078457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-30e7b0d2-b180-4187-9958-f19991e598ed req-f193fbc7-b400-42ee-8716-09fb2531118b service nova] Creating event network-vif-plugged:66e48c64-aab6-4386-8f4e-c36d3e4b5fc0 for instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 on hv-cinder-83754 Jul 28 18:02:39.083882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-30e7b0d2-b180-4187-9958-f19991e598ed req-f193fbc7-b400-42ee-8716-09fb2531118b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094828 Jul 28 18:02:39.087372 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-cc2e5b87-3f24-4d66-91e0-e1959b1301a1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:39.089171 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 68/122] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:39.096544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cc2e5b87-3f24-4d66-91e0-e1959b1301a1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.336373 Jul 28 18:02:39.109954 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 55/123] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:38 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:39.116448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:39.117986 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:39.126567 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:39.127507 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:39.128494 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:39.129245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:39.400012 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:39.403796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:39.412614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:39.412614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:39.413245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-47ccfcce-56c5-46f6-b670-8bffd1bce6f7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.301322 Jul 28 18:02:39.414811 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 69/124] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:39 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:40.014702 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2201ef32-b7c5-4a3f-9c69-34c21be7f381 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:40.015315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2201ef32-b7c5-4a3f-9c69-34c21be7f381 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:40.021564 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2201ef32-b7c5-4a3f-9c69-34c21be7f381 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:40.028837 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2201ef32-b7c5-4a3f-9c69-34c21be7f381 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:40.028837 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2201ef32-b7c5-4a3f-9c69-34c21be7f381 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:40.028837 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2201ef32-b7c5-4a3f-9c69-34c21be7f381 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:40.128441 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a5d2174a-224a-4b8a-bc99-758554aa06eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:40.131343 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a5d2174a-224a-4b8a-bc99-758554aa06eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:40.151836 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5d2174a-224a-4b8a-bc99-758554aa06eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:40.155042 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5d2174a-224a-4b8a-bc99-758554aa06eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:40.156658 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5d2174a-224a-4b8a-bc99-758554aa06eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:40.158640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5d2174a-224a-4b8a-bc99-758554aa06eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:40.184807 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2201ef32-b7c5-4a3f-9c69-34c21be7f381 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:40.193930 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2201ef32-b7c5-4a3f-9c69-34c21be7f381 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.184082 Jul 28 18:02:40.194710 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 56/125] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:40 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:40.314419 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a5d2174a-224a-4b8a-bc99-758554aa06eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:40.322093 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a5d2174a-224a-4b8a-bc99-758554aa06eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.203409 Jul 28 18:02:40.322695 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 70/126] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:40 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:40.445515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:40.452116 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:40.455206 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:40.455656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:40.456468 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:40.456947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:40.632083 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:40.641712 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:40.643999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:40.645587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8be5d820-7ddf-423c-aa49-4916dda6b9b8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.204118 Jul 28 18:02:40.646331 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 57/127] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:40 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:41.216173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cdd34644-38f7-4edc-9134-23cf75f7e0e8 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:41.216780 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cdd34644-38f7-4edc-9134-23cf75f7e0e8 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:41.223359 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cdd34644-38f7-4edc-9134-23cf75f7e0e8 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:41.223829 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cdd34644-38f7-4edc-9134-23cf75f7e0e8 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:41.224909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cdd34644-38f7-4edc-9134-23cf75f7e0e8 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:41.225417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cdd34644-38f7-4edc-9134-23cf75f7e0e8 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:41.343514 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a470ba44-5a31-4fc4-bdb8-93f2aacfdd9e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:41.344851 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a470ba44-5a31-4fc4-bdb8-93f2aacfdd9e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:41.357326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a470ba44-5a31-4fc4-bdb8-93f2aacfdd9e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:41.357326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a470ba44-5a31-4fc4-bdb8-93f2aacfdd9e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:41.357326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a470ba44-5a31-4fc4-bdb8-93f2aacfdd9e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:41.357962 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a470ba44-5a31-4fc4-bdb8-93f2aacfdd9e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:41.371019 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cdd34644-38f7-4edc-9134-23cf75f7e0e8 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:41.378805 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cdd34644-38f7-4edc-9134-23cf75f7e0e8 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.167330 Jul 28 18:02:41.379701 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 71/128] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:41 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:41.503551 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a470ba44-5a31-4fc4-bdb8-93f2aacfdd9e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:41.512742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a470ba44-5a31-4fc4-bdb8-93f2aacfdd9e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.173977 Jul 28 18:02:41.525763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 58/129] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:41 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:41.669734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:41.670382 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:41.676954 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:41.677402 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:41.678428 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:41.679117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:41.814827 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:41.844791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:41.846976 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:41.849085 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a428f6e5-5253-4ea0-be1a-630b18cc7a79 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.184211 Jul 28 18:02:41.850226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 72/130] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:41 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:42.401475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-12d18646-3cd6-4b3c-8e59-8e4ba3a534b9 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:42.402071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-12d18646-3cd6-4b3c-8e59-8e4ba3a534b9 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:42.408457 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12d18646-3cd6-4b3c-8e59-8e4ba3a534b9 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:42.408907 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12d18646-3cd6-4b3c-8e59-8e4ba3a534b9 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:42.409730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12d18646-3cd6-4b3c-8e59-8e4ba3a534b9 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:42.410168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12d18646-3cd6-4b3c-8e59-8e4ba3a534b9 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:42.533399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a58961ed-b411-4cd8-9e8a-79fe558ea413 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:42.534600 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a58961ed-b411-4cd8-9e8a-79fe558ea413 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:42.542740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a58961ed-b411-4cd8-9e8a-79fe558ea413 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:42.543189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a58961ed-b411-4cd8-9e8a-79fe558ea413 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:42.544191 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a58961ed-b411-4cd8-9e8a-79fe558ea413 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:42.544610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a58961ed-b411-4cd8-9e8a-79fe558ea413 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:42.617762 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-12d18646-3cd6-4b3c-8e59-8e4ba3a534b9 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:42.625927 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:42.635215 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-12d18646-3cd6-4b3c-8e59-8e4ba3a534b9 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.237917 Jul 28 18:02:42.637061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 59/131] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:42 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:42.710271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a58961ed-b411-4cd8-9e8a-79fe558ea413 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:42.719114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a58961ed-b411-4cd8-9e8a-79fe558ea413 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.189886 Jul 28 18:02:42.719696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 73/132] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:42 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:42.876154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:42.876759 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:42.883391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:42.884085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:42.884861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:42.885291 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:43.077083 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:43.096062 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:43.113116 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:43.120834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d1047f45-c443-445b-9b4b-18a09bdd66a8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.245192 Jul 28 18:02:43.120834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 60/133] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:42 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:43.661153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fd7530e4-449b-441c-8834-b0e631b3fcdb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:43.661651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fd7530e4-449b-441c-8834-b0e631b3fcdb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:43.673406 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd7530e4-449b-441c-8834-b0e631b3fcdb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:43.673406 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd7530e4-449b-441c-8834-b0e631b3fcdb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:43.682477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd7530e4-449b-441c-8834-b0e631b3fcdb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:43.682569 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd7530e4-449b-441c-8834-b0e631b3fcdb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:43.740554 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5ef160c2-de5e-4c7d-a2ca-15675c56e613 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:43.741247 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5ef160c2-de5e-4c7d-a2ca-15675c56e613 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:43.753541 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ef160c2-de5e-4c7d-a2ca-15675c56e613 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:43.761095 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ef160c2-de5e-4c7d-a2ca-15675c56e613 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:43.761095 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ef160c2-de5e-4c7d-a2ca-15675c56e613 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:43.761095 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ef160c2-de5e-4c7d-a2ca-15675c56e613 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:43.872544 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fd7530e4-449b-441c-8834-b0e631b3fcdb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:43.882951 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fd7530e4-449b-441c-8834-b0e631b3fcdb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.226805 Jul 28 18:02:43.885635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 74/134] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:43 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:43.974464 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5ef160c2-de5e-4c7d-a2ca-15675c56e613 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:43.983411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5ef160c2-de5e-4c7d-a2ca-15675c56e613 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.247145 Jul 28 18:02:43.984469 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 61/135] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:43 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:44.166800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:44.166800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:44.168415 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:44.168946 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:44.170026 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:44.170724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:44.306632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:44.318859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:44.320366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:44.322806 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d177cf22-b195-48ea-a100-65480d921166 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.165147 Jul 28 18:02:44.323369 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 75/136] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:44 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:44.906114 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-42cfc19c-450b-49db-b81b-9458c4dbac02 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:44.906754 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-42cfc19c-450b-49db-b81b-9458c4dbac02 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:44.912956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-42cfc19c-450b-49db-b81b-9458c4dbac02 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:44.913407 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-42cfc19c-450b-49db-b81b-9458c4dbac02 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:44.914179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-42cfc19c-450b-49db-b81b-9458c4dbac02 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:44.915130 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-42cfc19c-450b-49db-b81b-9458c4dbac02 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:45.010008 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-82fd3a84-7851-4751-803c-784789d74bbc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:45.010677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-82fd3a84-7851-4751-803c-784789d74bbc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:45.017417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82fd3a84-7851-4751-803c-784789d74bbc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:45.018036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82fd3a84-7851-4751-803c-784789d74bbc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:45.019039 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82fd3a84-7851-4751-803c-784789d74bbc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:45.019457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82fd3a84-7851-4751-803c-784789d74bbc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:45.069743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-42cfc19c-450b-49db-b81b-9458c4dbac02 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:45.073434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-42cfc19c-450b-49db-b81b-9458c4dbac02 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.171001 Jul 28 18:02:45.074071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 62/137] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:44 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:45.188278 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-82fd3a84-7851-4751-803c-784789d74bbc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:45.196550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-82fd3a84-7851-4751-803c-784789d74bbc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.190770 Jul 28 18:02:45.197499 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 76/138] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:45 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:45.346645 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:45.347696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:45.354002 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:45.354587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:45.355445 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:45.355898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:45.490395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:45.506466 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:45.509073 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:45.510981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4df10765-510b-4898-8ee2-d040a84a3096 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.168179 Jul 28 18:02:45.511901 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 63/139] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:45 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:45.988868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-2b46a75b-d7aa-4104-ac38-c17c526d4d05 req-875f7bbf-0b60-409c-ba2e-103b0ef5baa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c194fd9-27de-4620-ae13-0d988b2adf4d", "name": "network-vif-plugged", "status": "completed", "tag": "c5407d67-f752-4458-a306-d8d20e45c534"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:46.002450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-2b46a75b-d7aa-4104-ac38-c17c526d4d05 req-875f7bbf-0b60-409c-ba2e-103b0ef5baa3 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:46.002832 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-2b46a75b-d7aa-4104-ac38-c17c526d4d05 req-875f7bbf-0b60-409c-ba2e-103b0ef5baa3 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:46.015806 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-2b46a75b-d7aa-4104-ac38-c17c526d4d05 req-875f7bbf-0b60-409c-ba2e-103b0ef5baa3 service nova] Creating event network-vif-plugged:c5407d67-f752-4458-a306-d8d20e45c534 for instance 8c194fd9-27de-4620-ae13-0d988b2adf4d on hv-cinder-83754 Jul 28 18:02:46.021963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-2b46a75b-d7aa-4104-ac38-c17c526d4d05 req-875f7bbf-0b60-409c-ba2e-103b0ef5baa3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037610 Jul 28 18:02:46.022609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 77/140] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:46.095370 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8b197e16-b3a3-4890-a704-e0f9b7ca8c84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:46.096024 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8b197e16-b3a3-4890-a704-e0f9b7ca8c84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:46.102071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b197e16-b3a3-4890-a704-e0f9b7ca8c84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:46.105363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b197e16-b3a3-4890-a704-e0f9b7ca8c84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:46.105363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b197e16-b3a3-4890-a704-e0f9b7ca8c84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:46.105363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b197e16-b3a3-4890-a704-e0f9b7ca8c84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:46.220423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a947a1cb-0c44-4dca-bbda-bf0b4f492251 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:46.238162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a947a1cb-0c44-4dca-bbda-bf0b4f492251 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:46.259077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a947a1cb-0c44-4dca-bbda-bf0b4f492251 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:46.259706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a947a1cb-0c44-4dca-bbda-bf0b4f492251 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:46.261321 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a947a1cb-0c44-4dca-bbda-bf0b4f492251 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:46.263752 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a947a1cb-0c44-4dca-bbda-bf0b4f492251 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:46.305748 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8b197e16-b3a3-4890-a704-e0f9b7ca8c84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:46.314728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8b197e16-b3a3-4890-a704-e0f9b7ca8c84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.223230 Jul 28 18:02:46.315506 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 64/141] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:46 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:46.435818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a947a1cb-0c44-4dca-bbda-bf0b4f492251 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:46.446755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a947a1cb-0c44-4dca-bbda-bf0b4f492251 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.230416 Jul 28 18:02:46.446755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 78/142] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:46 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:46.542086 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:46.543116 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:46.549550 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:46.550084 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:46.550965 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:46.551405 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:46.692554 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:46.704625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:46.704625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:46.705672 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-dfb1d5a4-5c94-42fc-abc3-b63f4ec15882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.168268 Jul 28 18:02:46.706580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 65/143] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:46 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:47.336795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5a089466-cafe-4b39-8daa-84a514a8d219 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:47.338905 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5a089466-cafe-4b39-8daa-84a514a8d219 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:47.345902 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5a089466-cafe-4b39-8daa-84a514a8d219 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:47.346435 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5a089466-cafe-4b39-8daa-84a514a8d219 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:47.347153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5a089466-cafe-4b39-8daa-84a514a8d219 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:47.347584 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5a089466-cafe-4b39-8daa-84a514a8d219 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:47.467023 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-30221789-cfda-4af4-81fd-56d8f9d3eafb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:47.467616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-30221789-cfda-4af4-81fd-56d8f9d3eafb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:47.476287 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-30221789-cfda-4af4-81fd-56d8f9d3eafb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:47.476808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-30221789-cfda-4af4-81fd-56d8f9d3eafb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:47.479331 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-30221789-cfda-4af4-81fd-56d8f9d3eafb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:47.479791 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-30221789-cfda-4af4-81fd-56d8f9d3eafb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:47.708595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-30221789-cfda-4af4-81fd-56d8f9d3eafb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:47.716929 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-30221789-cfda-4af4-81fd-56d8f9d3eafb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.255754 Jul 28 18:02:47.717678 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 66/144] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:47 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:47.734047 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5a089466-cafe-4b39-8daa-84a514a8d219 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:47.737606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:47.738441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:47.744842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5a089466-cafe-4b39-8daa-84a514a8d219 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.412116 Jul 28 18:02:47.747120 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 79/145] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:47 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:47.759654 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:47.760329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:47.761120 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:47.761553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:47.902007 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:47.909979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:47.917560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:47.917560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f11d092a-06a9-4c74-b45f-275302c7c6b9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.184313 Jul 28 18:02:47.917560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 67/146] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:47 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:48.038125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-5f68e2b7-ee19-4557-b7f8-2f342e0585fe req-d4854bea-50c2-4728-a75f-5c431735eb5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f64c566-cf5d-4240-95e2-c5746a5bba89", "name": "network-vif-plugged", "status": "completed", "tag": "8980c8f3-7810-4b7b-b88d-1b866e291a34"}, {"server_uuid": "e41bcb8c-0edb-453b-8954-2a2a9378a044", "name": "network-vif-plugged", "status": "completed", "tag": "56261dcb-db43-4b4f-884d-1f476a35889b"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:48.049592 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-5f68e2b7-ee19-4557-b7f8-2f342e0585fe req-d4854bea-50c2-4728-a75f-5c431735eb5a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:48.050033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-5f68e2b7-ee19-4557-b7f8-2f342e0585fe req-d4854bea-50c2-4728-a75f-5c431735eb5a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:48.063278 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-5f68e2b7-ee19-4557-b7f8-2f342e0585fe req-d4854bea-50c2-4728-a75f-5c431735eb5a service nova] Creating event network-vif-plugged:8980c8f3-7810-4b7b-b88d-1b866e291a34 for instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 on hv-cinder-83754 Jul 28 18:02:48.063854 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-5f68e2b7-ee19-4557-b7f8-2f342e0585fe req-d4854bea-50c2-4728-a75f-5c431735eb5a service nova] Creating event network-vif-plugged:56261dcb-db43-4b4f-884d-1f476a35889b for instance e41bcb8c-0edb-453b-8954-2a2a9378a044 on hv-cinder-83754 Jul 28 18:02:48.070629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-5f68e2b7-ee19-4557-b7f8-2f342e0585fe req-d4854bea-50c2-4728-a75f-5c431735eb5a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035960 Jul 28 18:02:48.071150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 80/147] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:02:48.742040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4039076f-19db-4ebc-9f42-20c194a9b6f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:48.744954 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4039076f-19db-4ebc-9f42-20c194a9b6f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:48.752725 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4039076f-19db-4ebc-9f42-20c194a9b6f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:48.756030 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4039076f-19db-4ebc-9f42-20c194a9b6f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:48.756884 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4039076f-19db-4ebc-9f42-20c194a9b6f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:48.757279 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4039076f-19db-4ebc-9f42-20c194a9b6f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:48.770408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-544f9793-2f4a-4598-9aaf-006f0b0df772 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:48.771182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-544f9793-2f4a-4598-9aaf-006f0b0df772 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:48.778729 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-544f9793-2f4a-4598-9aaf-006f0b0df772 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:48.779269 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-544f9793-2f4a-4598-9aaf-006f0b0df772 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:48.780122 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-544f9793-2f4a-4598-9aaf-006f0b0df772 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:48.780627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-544f9793-2f4a-4598-9aaf-006f0b0df772 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:48.903566 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4039076f-19db-4ebc-9f42-20c194a9b6f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:48.911192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4039076f-19db-4ebc-9f42-20c194a9b6f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.173458 Jul 28 18:02:48.911785 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 68/148] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:48 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:48.927821 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-544f9793-2f4a-4598-9aaf-006f0b0df772 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:48.937424 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-544f9793-2f4a-4598-9aaf-006f0b0df772 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.174007 Jul 28 18:02:48.938422 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:48.939263 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:48.945566 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:48.946020 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:48.947709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:48.948152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:48.948720 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 81/149] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:48 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:49.082134 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:49.090453 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:49.091997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:49.093104 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5db44403-fbbd-487b-b5a3-4ede219665ab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.158978 Jul 28 18:02:49.093671 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 69/150] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:48 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:02:49.940968 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-defef839-e461-4730-b8fe-475a498a7043 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:49.941577 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-defef839-e461-4730-b8fe-475a498a7043 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:49.948232 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-defef839-e461-4730-b8fe-475a498a7043 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:49.948770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-defef839-e461-4730-b8fe-475a498a7043 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:49.952740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-defef839-e461-4730-b8fe-475a498a7043 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:49.952740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-defef839-e461-4730-b8fe-475a498a7043 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:49.960363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-37b73aa6-bfd5-4497-92c3-376d4afc6c5b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:49.960969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-37b73aa6-bfd5-4497-92c3-376d4afc6c5b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:49.967250 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-37b73aa6-bfd5-4497-92c3-376d4afc6c5b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:49.967727 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-37b73aa6-bfd5-4497-92c3-376d4afc6c5b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:49.968894 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-37b73aa6-bfd5-4497-92c3-376d4afc6c5b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:49.976225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-37b73aa6-bfd5-4497-92c3-376d4afc6c5b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:50.086985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-defef839-e461-4730-b8fe-475a498a7043 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:50.095295 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-defef839-e461-4730-b8fe-475a498a7043 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1321 microversion: 2.1 time: 0.158246 Jul 28 18:02:50.095875 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 82/151] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:49 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:50.115495 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-37b73aa6-bfd5-4497-92c3-376d4afc6c5b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:50.117711 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:50.119649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:50.124297 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-37b73aa6-bfd5-4497-92c3-376d4afc6c5b tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.167787 Jul 28 18:02:50.125088 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 70/152] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:49 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:50.126161 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:50.126654 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:50.127706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:50.128145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:50.268209 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:50.276458 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:50.277963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:50.279098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3285eee7-3d87-4527-a86c-81109a799fd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.166115 Jul 28 18:02:50.283139 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 83/153] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:50 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:02:51.122014 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f9069d51-ee28-48c1-81da-18e7d4853afd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:51.123118 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f9069d51-ee28-48c1-81da-18e7d4853afd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:51.131264 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f9069d51-ee28-48c1-81da-18e7d4853afd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:51.132141 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f9069d51-ee28-48c1-81da-18e7d4853afd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:51.132926 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f9069d51-ee28-48c1-81da-18e7d4853afd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:51.133457 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f9069d51-ee28-48c1-81da-18e7d4853afd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:51.146732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3b2023aa-bcf5-4440-8775-2d660ab018d5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:51.147607 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3b2023aa-bcf5-4440-8775-2d660ab018d5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:51.154901 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b2023aa-bcf5-4440-8775-2d660ab018d5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:51.155593 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b2023aa-bcf5-4440-8775-2d660ab018d5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:51.156377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b2023aa-bcf5-4440-8775-2d660ab018d5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:51.156982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b2023aa-bcf5-4440-8775-2d660ab018d5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:51.302524 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f9069d51-ee28-48c1-81da-18e7d4853afd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:51.311352 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f9069d51-ee28-48c1-81da-18e7d4853afd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1515 microversion: 2.1 time: 0.197894 Jul 28 18:02:51.311947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 71/154] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:51 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:51.316555 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:51.317153 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:51.324527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:51.324980 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:51.325746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:51.326183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:51.492129 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:51.502190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:51.503812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:51.504912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d7c4ee3d-d3aa-4f01-8596-46b110d67fca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.192048 Jul 28 18:02:51.509956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 72/155] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:51 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:51.511220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cadf0bf9-b439-4159-bef5-aa4b87aaf242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:51.513520 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cadf0bf9-b439-4159-bef5-aa4b87aaf242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:51.519730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cadf0bf9-b439-4159-bef5-aa4b87aaf242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:51.520168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cadf0bf9-b439-4159-bef5-aa4b87aaf242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:51.520931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cadf0bf9-b439-4159-bef5-aa4b87aaf242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:51.521490 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cadf0bf9-b439-4159-bef5-aa4b87aaf242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:51.548368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3b2023aa-bcf5-4440-8775-2d660ab018d5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:51.556324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3b2023aa-bcf5-4440-8775-2d660ab018d5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.413998 Jul 28 18:02:51.557450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 84/156] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:51 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:51.587187 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-cadf0bf9-b439-4159-bef5-aa4b87aaf242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'flavor' on Instance uuid 8c194fd9-27de-4620-ae13-0d988b2adf4d {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:02:51.973052 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cadf0bf9-b439-4159-bef5-aa4b87aaf242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d/action" status: 200 len: 32 microversion: 2.1 time: 0.465950 Jul 28 18:02:51.973751 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 73/157] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:02:51 2022] POST /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:02:51.983934 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c216afb2-df81-489f-9e2c-6bdb4a2545e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:51.984689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c216afb2-df81-489f-9e2c-6bdb4a2545e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:51.998118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c216afb2-df81-489f-9e2c-6bdb4a2545e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:52.003759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c216afb2-df81-489f-9e2c-6bdb4a2545e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:52.004699 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c216afb2-df81-489f-9e2c-6bdb4a2545e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:52.005289 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c216afb2-df81-489f-9e2c-6bdb4a2545e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:52.146525 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c216afb2-df81-489f-9e2c-6bdb4a2545e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:52.155825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c216afb2-df81-489f-9e2c-6bdb4a2545e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.175433 Jul 28 18:02:52.156459 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 85/158] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:51 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:52.529843 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:52.531497 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:52.540057 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:52.540696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:52.542013 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:52.543078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:52.580034 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5f46c9df-c998-48fb-8a8d-5880e09997f0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:52.580635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5f46c9df-c998-48fb-8a8d-5880e09997f0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:52.588542 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:52.589283 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f46c9df-c998-48fb-8a8d-5880e09997f0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:52.589283 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f46c9df-c998-48fb-8a8d-5880e09997f0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:52.589562 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f46c9df-c998-48fb-8a8d-5880e09997f0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:52.590128 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f46c9df-c998-48fb-8a8d-5880e09997f0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:52.746724 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:52.758053 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:52.763474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:52.764820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4a6bfcc8-5f04-42c5-bf01-cc5eb79acb19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.239412 Jul 28 18:02:52.767351 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 74/159] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:52 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:52.772659 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5f46c9df-c998-48fb-8a8d-5880e09997f0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:52.781808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5f46c9df-c998-48fb-8a8d-5880e09997f0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.206118 Jul 28 18:02:52.782393 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 86/160] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:52 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:53.176859 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-dea5153d-630d-4aaf-b5ca-ae48795b97e6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:53.177833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-dea5153d-630d-4aaf-b5ca-ae48795b97e6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:53.185454 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dea5153d-630d-4aaf-b5ca-ae48795b97e6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:53.186120 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dea5153d-630d-4aaf-b5ca-ae48795b97e6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:53.187082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dea5153d-630d-4aaf-b5ca-ae48795b97e6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:53.187646 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dea5153d-630d-4aaf-b5ca-ae48795b97e6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:53.342504 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-dea5153d-630d-4aaf-b5ca-ae48795b97e6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:53.350144 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-dea5153d-630d-4aaf-b5ca-ae48795b97e6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.177111 Jul 28 18:02:53.350985 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 75/161] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:53 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:53.787697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:53.788413 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:53.794854 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:53.795368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:53.796135 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:53.796568 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:53.804621 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1be2b40b-3a90-4c9a-8248-b341214e7502 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:53.805556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1be2b40b-3a90-4c9a-8248-b341214e7502 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:53.814915 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1be2b40b-3a90-4c9a-8248-b341214e7502 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:53.815475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1be2b40b-3a90-4c9a-8248-b341214e7502 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:53.816645 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1be2b40b-3a90-4c9a-8248-b341214e7502 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:53.817145 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1be2b40b-3a90-4c9a-8248-b341214e7502 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:53.945245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:53.949898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:02:53.954825 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1be2b40b-3a90-4c9a-8248-b341214e7502 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:53.955422 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:53.957029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:53.958213 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c28772c4-c8cf-4d53-a305-da2b25497dfb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.174376 Jul 28 18:02:53.958812 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 87/162] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:53 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:53.962938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1be2b40b-3a90-4c9a-8248-b341214e7502 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.162615 Jul 28 18:02:53.963513 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 76/163] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:53 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:54.372462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5147a48f-4b49-44a7-9a70-ca948f9d37de tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:54.373098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5147a48f-4b49-44a7-9a70-ca948f9d37de tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:54.379581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5147a48f-4b49-44a7-9a70-ca948f9d37de tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:54.380028 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5147a48f-4b49-44a7-9a70-ca948f9d37de tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:54.380817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5147a48f-4b49-44a7-9a70-ca948f9d37de tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:54.381249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5147a48f-4b49-44a7-9a70-ca948f9d37de tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:54.514977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5147a48f-4b49-44a7-9a70-ca948f9d37de tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:54.522402 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5147a48f-4b49-44a7-9a70-ca948f9d37de tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.154191 Jul 28 18:02:54.522967 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 88/164] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:54 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:54.981711 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:54.982374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:54.983931 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-091effca-5fa7-4b0c-b9e1-aeaf8a8bebfb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:54.984533 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-091effca-5fa7-4b0c-b9e1-aeaf8a8bebfb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:54.989234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:54.989682 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:54.990391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-091effca-5fa7-4b0c-b9e1-aeaf8a8bebfb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:54.990508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:54.990837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-091effca-5fa7-4b0c-b9e1-aeaf8a8bebfb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:54.990928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:54.991590 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-091effca-5fa7-4b0c-b9e1-aeaf8a8bebfb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:54.992017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-091effca-5fa7-4b0c-b9e1-aeaf8a8bebfb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:55.122801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-091effca-5fa7-4b0c-b9e1-aeaf8a8bebfb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:55.124862 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:55.130805 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-091effca-5fa7-4b0c-b9e1-aeaf8a8bebfb tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1315 microversion: 2.1 time: 0.150750 Jul 28 18:02:55.131372 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 89/165] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:54 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:02:55.133039 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:55.134636 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:55.135981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ba71e4e0-e84a-4c0a-bde5-a8c4072f5bdd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.158376 Jul 28 18:02:55.136519 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 77/166] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:54 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:55.544152 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f9a0fb5a-d0d9-4586-adfd-a2a80c1c197e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:55.544752 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f9a0fb5a-d0d9-4586-adfd-a2a80c1c197e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:55.550746 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb5a-d0d9-4586-adfd-a2a80c1c197e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:55.551193 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb5a-d0d9-4586-adfd-a2a80c1c197e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:55.551945 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb5a-d0d9-4586-adfd-a2a80c1c197e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:55.552378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f9a0fb5a-d0d9-4586-adfd-a2a80c1c197e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:55.681324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f9a0fb5a-d0d9-4586-adfd-a2a80c1c197e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:55.689658 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f9a0fb5a-d0d9-4586-adfd-a2a80c1c197e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.150045 Jul 28 18:02:55.690222 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 90/167] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:55 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:56.153004 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-39146542-18f7-4617-bf7e-474b008bb2c5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:56.153623 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-39146542-18f7-4617-bf7e-474b008bb2c5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:56.158826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:56.160043 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:56.160183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-39146542-18f7-4617-bf7e-474b008bb2c5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:56.160648 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-39146542-18f7-4617-bf7e-474b008bb2c5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:56.162057 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-39146542-18f7-4617-bf7e-474b008bb2c5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:56.162057 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-39146542-18f7-4617-bf7e-474b008bb2c5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:56.166480 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:56.166940 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:56.167866 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:56.168772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:56.305996 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-39146542-18f7-4617-bf7e-474b008bb2c5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:56.315740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-39146542-18f7-4617-bf7e-474b008bb2c5 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1501 microversion: 2.1 time: 0.167672 Jul 28 18:02:56.316532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 78/168] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:56 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:56.336650 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:56.351189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:56.353360 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:56.355361 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-63df6c4a-ab1e-450f-a6af-51974639175b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1406 microversion: 2.20 time: 0.200733 Jul 28 18:02:56.355921 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 91/169] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:56 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:56.710421 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6d5168ae-1f85-41d8-ace4-e60f74ae85bf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:56.711030 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6d5168ae-1f85-41d8-ace4-e60f74ae85bf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:56.717383 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d5168ae-1f85-41d8-ace4-e60f74ae85bf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:56.717892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d5168ae-1f85-41d8-ace4-e60f74ae85bf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:56.718656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d5168ae-1f85-41d8-ace4-e60f74ae85bf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:56.719092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d5168ae-1f85-41d8-ace4-e60f74ae85bf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:56.863911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6d5168ae-1f85-41d8-ace4-e60f74ae85bf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:56.872898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6d5168ae-1f85-41d8-ace4-e60f74ae85bf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.166465 Jul 28 18:02:56.873458 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 79/170] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:56 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:57.382801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:57.383421 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:57.389983 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:57.390461 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:57.391245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:57.391669 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:57.520768 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:57.529547 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:57.531104 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:57.532250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-dfeb6096-70c2-4b57-a95e-5275b686f2ff tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1599 microversion: 2.20 time: 0.153337 Jul 28 18:02:57.532809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 92/171] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:02:57 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:02:57.555123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ed4b29c5-b849-44ac-b9f8-afc098f8a56f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:57.555644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ed4b29c5-b849-44ac-b9f8-afc098f8a56f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:57.562500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ed4b29c5-b849-44ac-b9f8-afc098f8a56f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:57.562943 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ed4b29c5-b849-44ac-b9f8-afc098f8a56f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:57.563709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ed4b29c5-b849-44ac-b9f8-afc098f8a56f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:57.564142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ed4b29c5-b849-44ac-b9f8-afc098f8a56f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:57.642465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ed4b29c5-b849-44ac-b9f8-afc098f8a56f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091104 Jul 28 18:02:57.643056 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 80/172] 10.222.0.85 () {60 vars in 1316 bytes} [Thu Jul 28 18:02:57 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:02:57.894622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-263bea00-8988-4a17-bf49-edce6ebc8c94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:57.896485 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-263bea00-8988-4a17-bf49-edce6ebc8c94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:57.902686 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-263bea00-8988-4a17-bf49-edce6ebc8c94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:57.903213 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-263bea00-8988-4a17-bf49-edce6ebc8c94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:57.903909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-263bea00-8988-4a17-bf49-edce6ebc8c94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:57.904340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-263bea00-8988-4a17-bf49-edce6ebc8c94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:58.049539 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-263bea00-8988-4a17-bf49-edce6ebc8c94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:58.058505 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-263bea00-8988-4a17-bf49-edce6ebc8c94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.166784 Jul 28 18:02:58.059227 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 93/173] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:57 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:02:59.085236 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ae3ca006-8679-4785-b7d2-7b2f5a24481b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:02:59.085799 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ae3ca006-8679-4785-b7d2-7b2f5a24481b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:02:59.092263 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ae3ca006-8679-4785-b7d2-7b2f5a24481b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:59.092720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ae3ca006-8679-4785-b7d2-7b2f5a24481b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:59.093495 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ae3ca006-8679-4785-b7d2-7b2f5a24481b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:59.093932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ae3ca006-8679-4785-b7d2-7b2f5a24481b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:59.141949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-87afc3c9-3ef1-4490-96a5-04bbaa9785b9 req-04281740-6f61-4dda-8030-dacef66d2e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f64c566-cf5d-4240-95e2-c5746a5bba89", "tag": "8980c8f3-7810-4b7b-b88d-1b866e291a34"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:02:59.160955 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-87afc3c9-3ef1-4490-96a5-04bbaa9785b9 req-04281740-6f61-4dda-8030-dacef66d2e3a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:02:59.162277 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-87afc3c9-3ef1-4490-96a5-04bbaa9785b9 req-04281740-6f61-4dda-8030-dacef66d2e3a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:02:59.175838 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-87afc3c9-3ef1-4490-96a5-04bbaa9785b9 req-04281740-6f61-4dda-8030-dacef66d2e3a service nova] Creating event network-changed:8980c8f3-7810-4b7b-b88d-1b866e291a34 for instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 on hv-cinder-83754 Jul 28 18:02:59.186607 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-87afc3c9-3ef1-4490-96a5-04bbaa9785b9 req-04281740-6f61-4dda-8030-dacef66d2e3a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048728 Jul 28 18:02:59.187990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 94/174] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:02:59.302827 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ae3ca006-8679-4785-b7d2-7b2f5a24481b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:02:59.307830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ae3ca006-8679-4785-b7d2-7b2f5a24481b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.226537 Jul 28 18:02:59.316426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 81/175] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:02:59 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:00.330280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-18103262-550a-4410-9233-b7fc7df8d68e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:00.331007 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-18103262-550a-4410-9233-b7fc7df8d68e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:00.343111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-18103262-550a-4410-9233-b7fc7df8d68e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:00.343111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-18103262-550a-4410-9233-b7fc7df8d68e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:00.343111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-18103262-550a-4410-9233-b7fc7df8d68e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:00.343111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-18103262-550a-4410-9233-b7fc7df8d68e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:00.517997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-18103262-550a-4410-9233-b7fc7df8d68e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:00.528682 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-18103262-550a-4410-9233-b7fc7df8d68e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.203324 Jul 28 18:03:00.529271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 95/176] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:00 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:01.550281 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2ccc6757-e6a5-4dc1-a778-2cf5e4ecbc95 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:01.550926 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2ccc6757-e6a5-4dc1-a778-2cf5e4ecbc95 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:01.553053 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=79 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:01.558477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2ccc6757-e6a5-4dc1-a778-2cf5e4ecbc95 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:01.558932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2ccc6757-e6a5-4dc1-a778-2cf5e4ecbc95 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:01.559708 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2ccc6757-e6a5-4dc1-a778-2cf5e4ecbc95 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:01.562832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2ccc6757-e6a5-4dc1-a778-2cf5e4ecbc95 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:01.692742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2ccc6757-e6a5-4dc1-a778-2cf5e4ecbc95 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:01.702411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2ccc6757-e6a5-4dc1-a778-2cf5e4ecbc95 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.155882 Jul 28 18:03:01.703050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 82/177] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:01 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:02.723188 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fc57c267-92c5-4edc-a3ff-0cde4de45316 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:02.723739 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fc57c267-92c5-4edc-a3ff-0cde4de45316 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:02.725706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=80 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:02.730484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fc57c267-92c5-4edc-a3ff-0cde4de45316 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:02.730934 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fc57c267-92c5-4edc-a3ff-0cde4de45316 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:02.731694 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fc57c267-92c5-4edc-a3ff-0cde4de45316 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:02.732136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fc57c267-92c5-4edc-a3ff-0cde4de45316 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:02.867051 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fc57c267-92c5-4edc-a3ff-0cde4de45316 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:02.874737 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fc57c267-92c5-4edc-a3ff-0cde4de45316 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.155452 Jul 28 18:03:02.875302 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 96/178] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:02 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:03.897125 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c383f262-969b-4cca-9e3e-50c5ed0929cf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:03.898225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c383f262-969b-4cca-9e3e-50c5ed0929cf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:03.904869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c383f262-969b-4cca-9e3e-50c5ed0929cf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:03.905393 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c383f262-969b-4cca-9e3e-50c5ed0929cf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:03.906296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c383f262-969b-4cca-9e3e-50c5ed0929cf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:03.906816 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c383f262-969b-4cca-9e3e-50c5ed0929cf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:04.053592 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c383f262-969b-4cca-9e3e-50c5ed0929cf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:04.061810 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c383f262-969b-4cca-9e3e-50c5ed0929cf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.168686 Jul 28 18:03:04.062408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 83/179] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:03 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:04.577408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-07752cba-caf4-4182-8931-d274fe5c6589 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43d5d546-8649-41b0-85bb-9c1ffdb28f5d"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:03:04.580479 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-07752cba-caf4-4182-8931-d274fe5c6589 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:04.586711 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-07752cba-caf4-4182-8931-d274fe5c6589 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:04.587158 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-07752cba-caf4-4182-8931-d274fe5c6589 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:04.587956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-07752cba-caf4-4182-8931-d274fe5c6589 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:04.590136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-07752cba-caf4-4182-8931-d274fe5c6589 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:05.086327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4bb793fa-450d-4f24-9aab-19287bd5bf81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:05.087362 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4bb793fa-450d-4f24-9aab-19287bd5bf81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:05.097381 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4bb793fa-450d-4f24-9aab-19287bd5bf81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:05.098435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4bb793fa-450d-4f24-9aab-19287bd5bf81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:05.099700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4bb793fa-450d-4f24-9aab-19287bd5bf81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:05.100422 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4bb793fa-450d-4f24-9aab-19287bd5bf81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:05.260067 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4bb793fa-450d-4f24-9aab-19287bd5bf81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:05.282086 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4bb793fa-450d-4f24-9aab-19287bd5bf81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.188313 Jul 28 18:03:05.282086 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 84/180] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:05 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:05.940895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-07752cba-caf4-4182-8931-d274fe5c6589 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "POST /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.367119 Jul 28 18:03:05.942263 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 97/181] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:03:04 2022] POST /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044/os-volume_attachments => generated 194 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:03:06.302328 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bc3a20fa-6fe6-417a-8225-558dd8ae59a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:06.303128 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bc3a20fa-6fe6-417a-8225-558dd8ae59a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:06.312333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc3a20fa-6fe6-417a-8225-558dd8ae59a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:06.312333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc3a20fa-6fe6-417a-8225-558dd8ae59a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:06.317417 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc3a20fa-6fe6-417a-8225-558dd8ae59a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:06.317417 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc3a20fa-6fe6-417a-8225-558dd8ae59a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:06.501207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bc3a20fa-6fe6-417a-8225-558dd8ae59a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:06.509133 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bc3a20fa-6fe6-417a-8225-558dd8ae59a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.210881 Jul 28 18:03:06.509697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 85/182] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:06 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:07.530301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-40720016-eed8-436e-9198-ee3b700bff9c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:07.535098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-40720016-eed8-436e-9198-ee3b700bff9c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:07.538837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-40720016-eed8-436e-9198-ee3b700bff9c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:07.539650 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-40720016-eed8-436e-9198-ee3b700bff9c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:07.540564 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-40720016-eed8-436e-9198-ee3b700bff9c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:07.541070 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-40720016-eed8-436e-9198-ee3b700bff9c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:07.809930 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-40720016-eed8-436e-9198-ee3b700bff9c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:07.812468 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-40720016-eed8-436e-9198-ee3b700bff9c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.286968 Jul 28 18:03:07.813223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 98/183] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:07 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:08.833018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e5f07b86-a8a8-424e-bbc0-f4335f8c403b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:08.833650 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e5f07b86-a8a8-424e-bbc0-f4335f8c403b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:08.841014 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5f07b86-a8a8-424e-bbc0-f4335f8c403b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:08.841453 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5f07b86-a8a8-424e-bbc0-f4335f8c403b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:08.842431 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5f07b86-a8a8-424e-bbc0-f4335f8c403b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:08.842733 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5f07b86-a8a8-424e-bbc0-f4335f8c403b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:08.978987 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e5f07b86-a8a8-424e-bbc0-f4335f8c403b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:08.988184 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e5f07b86-a8a8-424e-bbc0-f4335f8c403b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.158944 Jul 28 18:03:08.988860 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 86/184] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:08 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:10.011937 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-da706f34-9880-4701-9b78-f932012ea17d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:10.012558 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-da706f34-9880-4701-9b78-f932012ea17d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:10.018903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da706f34-9880-4701-9b78-f932012ea17d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:10.019640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da706f34-9880-4701-9b78-f932012ea17d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:10.020590 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da706f34-9880-4701-9b78-f932012ea17d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:10.021182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da706f34-9880-4701-9b78-f932012ea17d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:10.170027 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-da706f34-9880-4701-9b78-f932012ea17d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:10.179487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-da706f34-9880-4701-9b78-f932012ea17d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.171353 Jul 28 18:03:10.180017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 99/185] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:10 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:11.207545 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-756bcf06-5f78-45f6-823a-4bcf93e9e993 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:11.208116 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-756bcf06-5f78-45f6-823a-4bcf93e9e993 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:11.215065 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-756bcf06-5f78-45f6-823a-4bcf93e9e993 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:11.215509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-756bcf06-5f78-45f6-823a-4bcf93e9e993 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:11.216280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-756bcf06-5f78-45f6-823a-4bcf93e9e993 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:11.216715 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-756bcf06-5f78-45f6-823a-4bcf93e9e993 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:11.351684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-756bcf06-5f78-45f6-823a-4bcf93e9e993 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:11.360008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-756bcf06-5f78-45f6-823a-4bcf93e9e993 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.156444 Jul 28 18:03:11.360579 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 87/186] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:11 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:12.382443 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-96885451-e464-453b-b56b-f9b23a65ed0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:12.383076 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-96885451-e464-453b-b56b-f9b23a65ed0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:12.389760 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96885451-e464-453b-b56b-f9b23a65ed0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:12.390202 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96885451-e464-453b-b56b-f9b23a65ed0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:12.390990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96885451-e464-453b-b56b-f9b23a65ed0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:12.391419 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96885451-e464-453b-b56b-f9b23a65ed0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:12.519141 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-96885451-e464-453b-b56b-f9b23a65ed0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:12.526576 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-96885451-e464-453b-b56b-f9b23a65ed0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.147899 Jul 28 18:03:12.527142 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 100/187] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:12 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:03:13.548077 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6d801d4a-395f-470b-8add-e3108aebf2d4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:13.548696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6d801d4a-395f-470b-8add-e3108aebf2d4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:13.554730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d801d4a-395f-470b-8add-e3108aebf2d4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:13.558411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d801d4a-395f-470b-8add-e3108aebf2d4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:13.558411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d801d4a-395f-470b-8add-e3108aebf2d4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:13.558411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d801d4a-395f-470b-8add-e3108aebf2d4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:13.689561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6d801d4a-395f-470b-8add-e3108aebf2d4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:13.698483 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6d801d4a-395f-470b-8add-e3108aebf2d4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.154329 Jul 28 18:03:13.699042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 88/188] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:13 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:14.721536 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-51c872d8-f95b-44fc-95c2-d5e3a629de3d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:14.722142 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-51c872d8-f95b-44fc-95c2-d5e3a629de3d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:14.729055 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-51c872d8-f95b-44fc-95c2-d5e3a629de3d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:14.729577 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-51c872d8-f95b-44fc-95c2-d5e3a629de3d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:14.730583 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-51c872d8-f95b-44fc-95c2-d5e3a629de3d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:14.731015 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-51c872d8-f95b-44fc-95c2-d5e3a629de3d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:14.896860 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-51c872d8-f95b-44fc-95c2-d5e3a629de3d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:14.906892 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-51c872d8-f95b-44fc-95c2-d5e3a629de3d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.189434 Jul 28 18:03:14.907458 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 101/189] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:14 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:15.928683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4d3af88d-5450-4794-afd1-be10739f7586 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:15.929545 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4d3af88d-5450-4794-afd1-be10739f7586 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:15.939633 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d3af88d-5450-4794-afd1-be10739f7586 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:15.940082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d3af88d-5450-4794-afd1-be10739f7586 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:15.940881 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d3af88d-5450-4794-afd1-be10739f7586 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:15.941310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d3af88d-5450-4794-afd1-be10739f7586 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:16.125958 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4d3af88d-5450-4794-afd1-be10739f7586 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:16.136155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4d3af88d-5450-4794-afd1-be10739f7586 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.212147 Jul 28 18:03:16.136890 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 89/190] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:15 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:17.159123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9a27b21c-203b-4183-a0eb-c9b4bfb497b5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:17.159653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9a27b21c-203b-4183-a0eb-c9b4bfb497b5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:17.166947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9a27b21c-203b-4183-a0eb-c9b4bfb497b5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:17.167397 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9a27b21c-203b-4183-a0eb-c9b4bfb497b5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:17.168173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9a27b21c-203b-4183-a0eb-c9b4bfb497b5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:17.168612 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9a27b21c-203b-4183-a0eb-c9b4bfb497b5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:17.385997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9a27b21c-203b-4183-a0eb-c9b4bfb497b5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:17.394141 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9a27b21c-203b-4183-a0eb-c9b4bfb497b5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.238871 Jul 28 18:03:17.410676 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 102/191] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:17 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:18.418286 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-01a7cd4c-e856-4011-b6ef-b3a89ff5b6dd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:18.418940 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-01a7cd4c-e856-4011-b6ef-b3a89ff5b6dd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:18.432358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-01a7cd4c-e856-4011-b6ef-b3a89ff5b6dd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:18.432358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-01a7cd4c-e856-4011-b6ef-b3a89ff5b6dd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:18.432358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-01a7cd4c-e856-4011-b6ef-b3a89ff5b6dd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:18.432358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-01a7cd4c-e856-4011-b6ef-b3a89ff5b6dd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:18.584092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-01a7cd4c-e856-4011-b6ef-b3a89ff5b6dd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:18.592863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-01a7cd4c-e856-4011-b6ef-b3a89ff5b6dd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.179451 Jul 28 18:03:18.603527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 90/192] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:18 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:19.615150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fdc4b9dc-c0e2-4ba6-838e-5944ad2d5f67 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:19.615769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fdc4b9dc-c0e2-4ba6-838e-5944ad2d5f67 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:19.624343 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fdc4b9dc-c0e2-4ba6-838e-5944ad2d5f67 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:19.624782 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fdc4b9dc-c0e2-4ba6-838e-5944ad2d5f67 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:19.625829 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fdc4b9dc-c0e2-4ba6-838e-5944ad2d5f67 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:19.626268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fdc4b9dc-c0e2-4ba6-838e-5944ad2d5f67 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:19.851369 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fdc4b9dc-c0e2-4ba6-838e-5944ad2d5f67 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:19.856589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:19.866476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fdc4b9dc-c0e2-4ba6-838e-5944ad2d5f67 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.252081 Jul 28 18:03:19.866476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 103/193] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:19 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:20.888254 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-67f89e4b-f984-4f18-896b-2db359785de1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:20.889867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-67f89e4b-f984-4f18-896b-2db359785de1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:20.897666 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-67f89e4b-f984-4f18-896b-2db359785de1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:20.898496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-67f89e4b-f984-4f18-896b-2db359785de1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:20.899604 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-67f89e4b-f984-4f18-896b-2db359785de1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:20.900891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-67f89e4b-f984-4f18-896b-2db359785de1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:20.924958 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:21.111675 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-67f89e4b-f984-4f18-896b-2db359785de1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:21.131949 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-67f89e4b-f984-4f18-896b-2db359785de1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.250202 Jul 28 18:03:21.132752 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 91/194] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:20 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:22.167365 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cb6b6340-bc06-4c60-a6ce-ad0a42390dd0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:22.168989 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cb6b6340-bc06-4c60-a6ce-ad0a42390dd0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:22.175881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cb6b6340-bc06-4c60-a6ce-ad0a42390dd0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:22.176529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cb6b6340-bc06-4c60-a6ce-ad0a42390dd0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:22.177465 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cb6b6340-bc06-4c60-a6ce-ad0a42390dd0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:22.177896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cb6b6340-bc06-4c60-a6ce-ad0a42390dd0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:22.377780 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cb6b6340-bc06-4c60-a6ce-ad0a42390dd0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:22.391370 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cb6b6340-bc06-4c60-a6ce-ad0a42390dd0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.228197 Jul 28 18:03:22.405321 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 104/195] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:22 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:22.541836 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b2f5d653-3d66-4213-8bcd-d8c07996a66c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:22.543062 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b2f5d653-3d66-4213-8bcd-d8c07996a66c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:22.551040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b2f5d653-3d66-4213-8bcd-d8c07996a66c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:22.551765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b2f5d653-3d66-4213-8bcd-d8c07996a66c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:22.552662 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b2f5d653-3d66-4213-8bcd-d8c07996a66c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:22.553276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b2f5d653-3d66-4213-8bcd-d8c07996a66c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:22.585766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b2f5d653-3d66-4213-8bcd-d8c07996a66c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:03:22.968838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b2f5d653-3d66-4213-8bcd-d8c07996a66c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 204 len: 0 microversion: 2.1 time: 0.430870 Jul 28 18:03:22.970703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 92/196] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:03:22 2022] DELETE /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:03:22.979229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1c8ff895-e31f-4567-b7b4-246dd84fc29a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:22.979843 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1c8ff895-e31f-4567-b7b4-246dd84fc29a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:22.987189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1c8ff895-e31f-4567-b7b4-246dd84fc29a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:22.987639 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1c8ff895-e31f-4567-b7b4-246dd84fc29a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:22.988408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1c8ff895-e31f-4567-b7b4-246dd84fc29a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:22.989005 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1c8ff895-e31f-4567-b7b4-246dd84fc29a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:23.161049 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1c8ff895-e31f-4567-b7b4-246dd84fc29a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:23.169776 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1c8ff895-e31f-4567-b7b4-246dd84fc29a tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1553 microversion: 2.1 time: 0.195834 Jul 28 18:03:23.171215 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 105/197] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:22 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:23.418760 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fe3912f5-d4f4-4b63-9c43-4c690eb89b18 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:23.419468 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-fe3912f5-d4f4-4b63-9c43-4c690eb89b18 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:23.438656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fe3912f5-d4f4-4b63-9c43-4c690eb89b18 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:23.438656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fe3912f5-d4f4-4b63-9c43-4c690eb89b18 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:23.438656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fe3912f5-d4f4-4b63-9c43-4c690eb89b18 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:23.438656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fe3912f5-d4f4-4b63-9c43-4c690eb89b18 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:23.589660 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-fe3912f5-d4f4-4b63-9c43-4c690eb89b18 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:23.597562 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fe3912f5-d4f4-4b63-9c43-4c690eb89b18 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.184235 Jul 28 18:03:23.598129 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 93/198] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:23 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:03:24.192353 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-085c47a4-bb73-4491-8081-5889eaac3a1c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:24.193003 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-085c47a4-bb73-4491-8081-5889eaac3a1c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:24.201758 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-085c47a4-bb73-4491-8081-5889eaac3a1c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:24.202256 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-085c47a4-bb73-4491-8081-5889eaac3a1c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:24.203088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-085c47a4-bb73-4491-8081-5889eaac3a1c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:24.203524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-085c47a4-bb73-4491-8081-5889eaac3a1c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:24.393637 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-085c47a4-bb73-4491-8081-5889eaac3a1c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:24.405521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-085c47a4-bb73-4491-8081-5889eaac3a1c tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1553 microversion: 2.1 time: 0.217183 Jul 28 18:03:24.406883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 106/199] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:24 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:24.626227 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0059fd1f-3196-4397-b5e3-578b076f7b3c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:24.626892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0059fd1f-3196-4397-b5e3-578b076f7b3c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:24.655649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0059fd1f-3196-4397-b5e3-578b076f7b3c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:24.655649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0059fd1f-3196-4397-b5e3-578b076f7b3c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:24.655649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0059fd1f-3196-4397-b5e3-578b076f7b3c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:24.655649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0059fd1f-3196-4397-b5e3-578b076f7b3c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:24.797448 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0059fd1f-3196-4397-b5e3-578b076f7b3c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:24.805044 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0059fd1f-3196-4397-b5e3-578b076f7b3c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.188971 Jul 28 18:03:24.805609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 94/200] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:24 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:25.427977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e58c5b76-74e1-4b8f-9ba7-10a517ecab84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:25.432735 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e58c5b76-74e1-4b8f-9ba7-10a517ecab84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:25.438378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e58c5b76-74e1-4b8f-9ba7-10a517ecab84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:25.439027 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e58c5b76-74e1-4b8f-9ba7-10a517ecab84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:25.439875 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e58c5b76-74e1-4b8f-9ba7-10a517ecab84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:25.440305 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e58c5b76-74e1-4b8f-9ba7-10a517ecab84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:25.678505 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e58c5b76-74e1-4b8f-9ba7-10a517ecab84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:25.694616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e58c5b76-74e1-4b8f-9ba7-10a517ecab84 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1553 microversion: 2.1 time: 0.270974 Jul 28 18:03:25.695431 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 107/201] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:25 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1553 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:25.826421 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c6827359-9980-468b-a4d1-9e8fcef54739 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:25.827538 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c6827359-9980-468b-a4d1-9e8fcef54739 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:25.834077 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c6827359-9980-468b-a4d1-9e8fcef54739 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:25.834574 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c6827359-9980-468b-a4d1-9e8fcef54739 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:25.835425 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c6827359-9980-468b-a4d1-9e8fcef54739 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:25.835903 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c6827359-9980-468b-a4d1-9e8fcef54739 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:25.985819 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c6827359-9980-468b-a4d1-9e8fcef54739 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:25.994612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c6827359-9980-468b-a4d1-9e8fcef54739 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.172699 Jul 28 18:03:26.008546 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 95/202] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:25 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:26.314742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-7d0827e5-acd5-410b-a7ce-c63c99fda498 req-94da80a9-a843-41ab-85eb-c2379bb14603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e41bcb8c-0edb-453b-8954-2a2a9378a044", "name": "network-vif-deleted", "tag": "56261dcb-db43-4b4f-884d-1f476a35889b"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:03:26.326676 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-7d0827e5-acd5-410b-a7ce-c63c99fda498 req-94da80a9-a843-41ab-85eb-c2379bb14603 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:26.327133 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-7d0827e5-acd5-410b-a7ce-c63c99fda498 req-94da80a9-a843-41ab-85eb-c2379bb14603 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:26.340440 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-7d0827e5-acd5-410b-a7ce-c63c99fda498 req-94da80a9-a843-41ab-85eb-c2379bb14603 service nova] Creating event network-vif-deleted:56261dcb-db43-4b4f-884d-1f476a35889b for instance e41bcb8c-0edb-453b-8954-2a2a9378a044 on hv-cinder-83754 Jul 28 18:03:26.346667 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-7d0827e5-acd5-410b-a7ce-c63c99fda498 req-94da80a9-a843-41ab-85eb-c2379bb14603 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035811 Jul 28 18:03:26.350596 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 108/203] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:03:26.717474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-860a2690-1a9a-4e9a-8053-00b9b6d0fab6 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:26.720223 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-860a2690-1a9a-4e9a-8053-00b9b6d0fab6 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:26.724294 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-860a2690-1a9a-4e9a-8053-00b9b6d0fab6 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:26.724744 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-860a2690-1a9a-4e9a-8053-00b9b6d0fab6 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:26.725517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-860a2690-1a9a-4e9a-8053-00b9b6d0fab6 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:26.725951 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-860a2690-1a9a-4e9a-8053-00b9b6d0fab6 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:26.793231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-860a2690-1a9a-4e9a-8053-00b9b6d0fab6 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:26.801154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-860a2690-1a9a-4e9a-8053-00b9b6d0fab6 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1346 microversion: 2.1 time: 0.087526 Jul 28 18:03:26.801715 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 96/204] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:26 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:27.016841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-15d742d5-43ac-40b6-a1fa-f6d87060d850 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:27.017538 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-15d742d5-43ac-40b6-a1fa-f6d87060d850 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:27.023875 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-15d742d5-43ac-40b6-a1fa-f6d87060d850 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:27.024320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-15d742d5-43ac-40b6-a1fa-f6d87060d850 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:27.025938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-15d742d5-43ac-40b6-a1fa-f6d87060d850 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:27.026389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-15d742d5-43ac-40b6-a1fa-f6d87060d850 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:27.159826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-15d742d5-43ac-40b6-a1fa-f6d87060d850 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:27.168239 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-15d742d5-43ac-40b6-a1fa-f6d87060d850 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.156152 Jul 28 18:03:27.168804 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 109/205] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:27 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:27.821913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c7ef4831-1d6a-4c8f-b6d3-4a8df172e904 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:27.822774 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c7ef4831-1d6a-4c8f-b6d3-4a8df172e904 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:27.829789 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7ef4831-1d6a-4c8f-b6d3-4a8df172e904 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:27.831923 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7ef4831-1d6a-4c8f-b6d3-4a8df172e904 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:27.831923 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7ef4831-1d6a-4c8f-b6d3-4a8df172e904 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:27.831923 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7ef4831-1d6a-4c8f-b6d3-4a8df172e904 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:27.908177 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c7ef4831-1d6a-4c8f-b6d3-4a8df172e904 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:27.916982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c7ef4831-1d6a-4c8f-b6d3-4a8df172e904 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1346 microversion: 2.1 time: 0.098959 Jul 28 18:03:27.917565 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 97/206] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:27 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:28.189223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-decb8d39-93aa-4915-a383-abe12e120be0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:28.189915 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-decb8d39-93aa-4915-a383-abe12e120be0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:28.197359 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-decb8d39-93aa-4915-a383-abe12e120be0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:28.197909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-decb8d39-93aa-4915-a383-abe12e120be0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:28.198802 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-decb8d39-93aa-4915-a383-abe12e120be0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:28.199309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-decb8d39-93aa-4915-a383-abe12e120be0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:28.373908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-decb8d39-93aa-4915-a383-abe12e120be0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:28.382462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-decb8d39-93aa-4915-a383-abe12e120be0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.197130 Jul 28 18:03:28.387522 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 110/207] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:28 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:28.944308 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cd9de9f5-ac0f-4258-b226-a5907cf453c7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:28.944841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cd9de9f5-ac0f-4258-b226-a5907cf453c7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:28.951647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd9de9f5-ac0f-4258-b226-a5907cf453c7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:28.952095 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd9de9f5-ac0f-4258-b226-a5907cf453c7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:28.952861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd9de9f5-ac0f-4258-b226-a5907cf453c7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:28.953296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd9de9f5-ac0f-4258-b226-a5907cf453c7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:29.015163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-cd9de9f5-ac0f-4258-b226-a5907cf453c7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:29.027184 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cd9de9f5-ac0f-4258-b226-a5907cf453c7 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1346 microversion: 2.1 time: 0.086619 Jul 28 18:03:29.027887 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 98/208] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:28 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:29.406881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-17d0bb68-9ce2-400c-a7fa-750280e185ce tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:29.407642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-17d0bb68-9ce2-400c-a7fa-750280e185ce tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:29.414300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-17d0bb68-9ce2-400c-a7fa-750280e185ce tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:29.415089 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-17d0bb68-9ce2-400c-a7fa-750280e185ce tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:29.418268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-17d0bb68-9ce2-400c-a7fa-750280e185ce tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:29.418268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-17d0bb68-9ce2-400c-a7fa-750280e185ce tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:29.601205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-17d0bb68-9ce2-400c-a7fa-750280e185ce tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:29.609555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-17d0bb68-9ce2-400c-a7fa-750280e185ce tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.206759 Jul 28 18:03:29.610698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 111/209] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:29 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:30.047283 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4672cda7-cce1-44a8-9513-9f9cf524f931 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:30.048038 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4672cda7-cce1-44a8-9513-9f9cf524f931 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:30.054158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4672cda7-cce1-44a8-9513-9f9cf524f931 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:30.054644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4672cda7-cce1-44a8-9513-9f9cf524f931 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:30.059696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4672cda7-cce1-44a8-9513-9f9cf524f931 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:30.059696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4672cda7-cce1-44a8-9513-9f9cf524f931 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:30.126114 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4672cda7-cce1-44a8-9513-9f9cf524f931 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40605f70e0034578acbfc67f7b78b1d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e993449a4d58431cada94ec21f5a13d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:30.136381 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4672cda7-cce1-44a8-9513-9f9cf524f931 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 200 len: 1346 microversion: 2.1 time: 0.092724 Jul 28 18:03:30.137450 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 99/210] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:30 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:03:30.632711 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3978a565-36ae-44d0-ae0d-ead864326eed tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:30.634062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3978a565-36ae-44d0-ae0d-ead864326eed tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:30.652270 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3978a565-36ae-44d0-ae0d-ead864326eed tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:30.654432 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3978a565-36ae-44d0-ae0d-ead864326eed tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:30.655430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3978a565-36ae-44d0-ae0d-ead864326eed tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:30.657397 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3978a565-36ae-44d0-ae0d-ead864326eed tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:30.813602 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3978a565-36ae-44d0-ae0d-ead864326eed tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:30.826496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3978a565-36ae-44d0-ae0d-ead864326eed tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.199276 Jul 28 18:03:30.833751 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 112/211] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:30 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:31.157106 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:31.157718 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:31.164026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:31.164480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:31.165340 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:31.165781 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:31.181787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] HTTP exception thrown: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Request method failure captured: Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 HTTP/1.1 Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8ZRp-LIqmrI_0DqXhLUIq6GOgFEqu3jQ2bmkvdGje9Ey8zdMVU2ZznXCQUdbYdJSWpUZRV2fU3FjSYYtJGjfvCy3dth3_7kZjlTcuUSgWoC6JXu69VDg5NYRqF8nEsEJNj25sHnB23dujPIAbcXWVjlRtuSEzXbQZduPK5lUAR_UE Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: e993449a4d58431cada94ec21f5a13d9 Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:03:31.186207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e993449a4d58431cada94ec21f5a13d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: e993449a4d58431cada94ec21f5a13d9 Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-DeleteServersTestJSON-542083356-project Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 40605f70e0034578acbfc67f7b78b1d0 Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-DeleteServersTestJSON-542083356-project Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.193333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'e41bcb8c-0edb-453b-8954-2a2a9378a044'} Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:03:31.194255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.195590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.197476 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Returning 404 to user: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:03:31.197476 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8a582c6b-6845-4c72-9e94-207427d87839 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 404 len: 111 microversion: 2.1 time: 0.034515 Jul 28 18:03:31.197476 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 100/212] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:31 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:03:31.334093 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:31.334093 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:31.341727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:31.342446 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:31.343387 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:31.344218 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:31.360777 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] HTTP exception thrown: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Request method failure captured: Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044/os-volume_attachments HTTP/1.1 Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8ZRp-LIqmrI_0DqXhLUIq6GOgFEqu3jQ2bmkvdGje9Ey8zdMVU2ZznXCQUdbYdJSWpUZRV2fU3FjSYYtJGjfvCy3dth3_7kZjlTcuUSgWoC6JXu69VDg5NYRqF8nEsEJNj25sHnB23dujPIAbcXWVjlRtuSEzXbQZduPK5lUAR_UE Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: e993449a4d58431cada94ec21f5a13d9 Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:03:31.365842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e993449a4d58431cada94ec21f5a13d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: e993449a4d58431cada94ec21f5a13d9 Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-DeleteServersTestJSON-542083356-project Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 40605f70e0034578acbfc67f7b78b1d0 Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-DeleteServersTestJSON-542083356-project Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.367244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'server_id': 'e41bcb8c-0edb-453b-8954-2a2a9378a044'} Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:03:31.368449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:31.369614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:31.372156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Returning 404 to user: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:03:31.373255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cd96df26-02e2-4264-bf66-f66105514c40 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046250 Jul 28 18:03:31.373982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 113/213] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:03:31 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:03:31.854978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e4f92fc2-95d4-4217-94ac-80e81d5e7422 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:31.855511 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e4f92fc2-95d4-4217-94ac-80e81d5e7422 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:31.857520 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:31.862206 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4f92fc2-95d4-4217-94ac-80e81d5e7422 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:31.862700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4f92fc2-95d4-4217-94ac-80e81d5e7422 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:31.863464 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4f92fc2-95d4-4217-94ac-80e81d5e7422 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:31.863899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4f92fc2-95d4-4217-94ac-80e81d5e7422 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:32.023014 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e4f92fc2-95d4-4217-94ac-80e81d5e7422 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:32.049973 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e4f92fc2-95d4-4217-94ac-80e81d5e7422 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.198925 Jul 28 18:03:32.050544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 101/214] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:31 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:33.107198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e68f5b48-2b4f-4b44-aa4b-c8e970da817d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:33.107198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e68f5b48-2b4f-4b44-aa4b-c8e970da817d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:33.107198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=36 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:33.107198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e68f5b48-2b4f-4b44-aa4b-c8e970da817d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:33.107980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e68f5b48-2b4f-4b44-aa4b-c8e970da817d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:33.107980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e68f5b48-2b4f-4b44-aa4b-c8e970da817d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:33.107980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e68f5b48-2b4f-4b44-aa4b-c8e970da817d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:33.223521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e68f5b48-2b4f-4b44-aa4b-c8e970da817d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:33.233423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e68f5b48-2b4f-4b44-aa4b-c8e970da817d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.158481 Jul 28 18:03:33.233985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 114/215] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:33 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:33.724184 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:33.724707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:33.731765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:33.732213 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:33.732978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:33.733416 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:33.747418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] HTTP exception thrown: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Request method failure captured: Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 HTTP/1.1 Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8ZRp-LIqmrI_0DqXhLUIq6GOgFEqu3jQ2bmkvdGje9Ey8zdMVU2ZznXCQUdbYdJSWpUZRV2fU3FjSYYtJGjfvCy3dth3_7kZjlTcuUSgWoC6JXu69VDg5NYRqF8nEsEJNj25sHnB23dujPIAbcXWVjlRtuSEzXbQZduPK5lUAR_UE Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: e993449a4d58431cada94ec21f5a13d9 Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:03:33.748955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e993449a4d58431cada94ec21f5a13d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: e993449a4d58431cada94ec21f5a13d9 Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-DeleteServersTestJSON-542083356-project Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 40605f70e0034578acbfc67f7b78b1d0 Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-DeleteServersTestJSON-542083356-project Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.750488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'e41bcb8c-0edb-453b-8954-2a2a9378a044'} Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:03:33.751327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.752685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.754045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Returning 404 to user: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:03:33.754045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d4956b61-2e28-4476-b97a-a4e6ca1ec848 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 404 len: 111 microversion: 2.1 time: 0.030326 Jul 28 18:03:33.754045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 102/216] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:03:33 2022] DELETE /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:03:33.766686 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:33.766686 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] [instance: e41bcb8c-0edb-453b-8954-2a2a9378a044] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:33.768467 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:33.768971 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:33.769736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:33.770165 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:33.785628 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] HTTP exception thrown: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Request method failure captured: Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 HTTP/1.1 Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8ZRp-LIqmrI_0DqXhLUIq6GOgFEqu3jQ2bmkvdGje9Ey8zdMVU2ZznXCQUdbYdJSWpUZRV2fU3FjSYYtJGjfvCy3dth3_7kZjlTcuUSgWoC6JXu69VDg5NYRqF8nEsEJNj25sHnB23dujPIAbcXWVjlRtuSEzXbQZduPK5lUAR_UE Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: e993449a4d58431cada94ec21f5a13d9 Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:03:33.787917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_e993449a4d58431cada94ec21f5a13d9", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/e993449a4d58431cada94ec21f5a13d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: e993449a4d58431cada94ec21f5a13d9 Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-DeleteServersTestJSON-542083356 Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-DeleteServersTestJSON-542083356-project Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 40605f70e0034578acbfc67f7b78b1d0 Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-DeleteServersTestJSON-542083356-project Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.789341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': 'e41bcb8c-0edb-453b-8954-2a2a9378a044'} Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:03:33.792236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. Jul 28 18:03:33.793822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:03:33.800476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] Returning 404 to user: Instance e41bcb8c-0edb-453b-8954-2a2a9378a044 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:03:33.800476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-923c6b57-6ccd-4abc-a6df-d4bb69f80ce0 tempest-DeleteServersTestJSON-542083356 tempest-DeleteServersTestJSON-542083356-project] 10.222.0.85 "GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044" status: 404 len: 111 microversion: 2.1 time: 0.034524 Jul 28 18:03:33.800476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 115/217] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:33 2022] GET /compute/v2.1/servers/e41bcb8c-0edb-453b-8954-2a2a9378a044 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:03:34.255256 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a0f183d1-0a7d-4b63-ae31-6c4bba97d3e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:34.255884 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a0f183d1-0a7d-4b63-ae31-6c4bba97d3e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:34.263581 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0f183d1-0a7d-4b63-ae31-6c4bba97d3e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:34.264028 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0f183d1-0a7d-4b63-ae31-6c4bba97d3e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:34.269709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0f183d1-0a7d-4b63-ae31-6c4bba97d3e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:34.269709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0f183d1-0a7d-4b63-ae31-6c4bba97d3e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:34.511645 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a0f183d1-0a7d-4b63-ae31-6c4bba97d3e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:34.519369 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a0f183d1-0a7d-4b63-ae31-6c4bba97d3e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.268005 Jul 28 18:03:34.519937 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 103/218] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:34 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:35.541473 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a0b9a59f-fc4d-4134-b66f-8ee2cd3279ba tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:35.542503 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a0b9a59f-fc4d-4134-b66f-8ee2cd3279ba tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:35.549134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a0b9a59f-fc4d-4134-b66f-8ee2cd3279ba tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:35.549639 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a0b9a59f-fc4d-4134-b66f-8ee2cd3279ba tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:35.550655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a0b9a59f-fc4d-4134-b66f-8ee2cd3279ba tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:35.551092 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a0b9a59f-fc4d-4134-b66f-8ee2cd3279ba tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:35.711512 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a0b9a59f-fc4d-4134-b66f-8ee2cd3279ba tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:35.733256 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a0b9a59f-fc4d-4134-b66f-8ee2cd3279ba tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.196255 Jul 28 18:03:35.733837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 116/219] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:35 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:36.766233 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1382490c-f9aa-4583-8d17-8a4963b94cb2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:36.767608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1382490c-f9aa-4583-8d17-8a4963b94cb2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:36.778025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1382490c-f9aa-4583-8d17-8a4963b94cb2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:36.778721 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1382490c-f9aa-4583-8d17-8a4963b94cb2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:36.780670 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1382490c-f9aa-4583-8d17-8a4963b94cb2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:36.782908 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1382490c-f9aa-4583-8d17-8a4963b94cb2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:37.040625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1382490c-f9aa-4583-8d17-8a4963b94cb2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:37.103101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1382490c-f9aa-4583-8d17-8a4963b94cb2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.301938 Jul 28 18:03:37.103101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 104/220] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:36 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:38.125032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c6cd8b55-5279-4063-ae2e-9fb9371f80fa tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:38.126462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c6cd8b55-5279-4063-ae2e-9fb9371f80fa tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:38.145309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b55-5279-4063-ae2e-9fb9371f80fa tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:38.145785 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b55-5279-4063-ae2e-9fb9371f80fa tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:38.154916 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b55-5279-4063-ae2e-9fb9371f80fa tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:38.155305 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c6cd8b55-5279-4063-ae2e-9fb9371f80fa tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:38.490827 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c6cd8b55-5279-4063-ae2e-9fb9371f80fa tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:38.507593 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c6cd8b55-5279-4063-ae2e-9fb9371f80fa tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1521 microversion: 2.1 time: 0.389162 Jul 28 18:03:38.509819 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 117/221] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:38 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:39.529712 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8190d05d-7207-4cb0-b4c9-16ae95e9bdc3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:39.530323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8190d05d-7207-4cb0-b4c9-16ae95e9bdc3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:39.536587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8190d05d-7207-4cb0-b4c9-16ae95e9bdc3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:39.537040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8190d05d-7207-4cb0-b4c9-16ae95e9bdc3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:39.537838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8190d05d-7207-4cb0-b4c9-16ae95e9bdc3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:39.538300 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8190d05d-7207-4cb0-b4c9-16ae95e9bdc3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:39.679702 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8190d05d-7207-4cb0-b4c9-16ae95e9bdc3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:39.687942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8190d05d-7207-4cb0-b4c9-16ae95e9bdc3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1501 microversion: 2.1 time: 0.162067 Jul 28 18:03:39.689696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 105/222] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:39 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:39.709522 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-68e16f5e-325a-4764-ac10-87e483e9ead7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:39.710129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-68e16f5e-325a-4764-ac10-87e483e9ead7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:39.718450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-68e16f5e-325a-4764-ac10-87e483e9ead7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:39.718450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-68e16f5e-325a-4764-ac10-87e483e9ead7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:39.718450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-68e16f5e-325a-4764-ac10-87e483e9ead7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:39.718450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-68e16f5e-325a-4764-ac10-87e483e9ead7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:39.887980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-68e16f5e-325a-4764-ac10-87e483e9ead7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:39.897491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-68e16f5e-325a-4764-ac10-87e483e9ead7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1515 microversion: 2.1 time: 0.190236 Jul 28 18:03:39.897491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 118/223] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:39 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:03:41.873443 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9478ed70-48f7-435c-bee5-c4f607174242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:03:41.877643 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9478ed70-48f7-435c-bee5-c4f607174242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:41.883651 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9478ed70-48f7-435c-bee5-c4f607174242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:41.884337 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9478ed70-48f7-435c-bee5-c4f607174242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:41.885282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9478ed70-48f7-435c-bee5-c4f607174242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:41.885725 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9478ed70-48f7-435c-bee5-c4f607174242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:41.910208 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-9478ed70-48f7-435c-bee5-c4f607174242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'flavor' on Instance uuid e09c2f70-20f1-4762-b7ea-36d9ef650f15 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:03:41.998821 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:42.259897 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9478ed70-48f7-435c-bee5-c4f607174242 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15/action" status: 200 len: 32 microversion: 2.1 time: 0.391299 Jul 28 18:03:42.260981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 106/224] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:03:41 2022] POST /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 18:03:42.270601 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f3cc4710-7e8e-4e09-9eec-ee348ff5945a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:42.271334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f3cc4710-7e8e-4e09-9eec-ee348ff5945a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:42.279567 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f3cc4710-7e8e-4e09-9eec-ee348ff5945a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:42.280275 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f3cc4710-7e8e-4e09-9eec-ee348ff5945a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:42.281095 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f3cc4710-7e8e-4e09-9eec-ee348ff5945a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:42.281532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f3cc4710-7e8e-4e09-9eec-ee348ff5945a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:42.457379 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f3cc4710-7e8e-4e09-9eec-ee348ff5945a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:42.467304 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f3cc4710-7e8e-4e09-9eec-ee348ff5945a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.200765 Jul 28 18:03:42.468913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 119/225] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:42 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:43.491472 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6dbf335f-4791-4956-b243-d27965ba767d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:43.492694 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6dbf335f-4791-4956-b243-d27965ba767d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:43.504747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6dbf335f-4791-4956-b243-d27965ba767d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:43.504747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6dbf335f-4791-4956-b243-d27965ba767d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:43.504747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6dbf335f-4791-4956-b243-d27965ba767d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:43.504747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6dbf335f-4791-4956-b243-d27965ba767d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:43.656611 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6dbf335f-4791-4956-b243-d27965ba767d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:43.666399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6dbf335f-4791-4956-b243-d27965ba767d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.178650 Jul 28 18:03:43.667678 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 107/226] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:43 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:44.698265 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e0dcc2d8-6d5f-4d18-b9aa-f743f9dc519c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:44.699547 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e0dcc2d8-6d5f-4d18-b9aa-f743f9dc519c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:44.707098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e0dcc2d8-6d5f-4d18-b9aa-f743f9dc519c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:44.707550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e0dcc2d8-6d5f-4d18-b9aa-f743f9dc519c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:44.708332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e0dcc2d8-6d5f-4d18-b9aa-f743f9dc519c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:44.708770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e0dcc2d8-6d5f-4d18-b9aa-f743f9dc519c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:44.861394 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e0dcc2d8-6d5f-4d18-b9aa-f743f9dc519c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:44.870138 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e0dcc2d8-6d5f-4d18-b9aa-f743f9dc519c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.177570 Jul 28 18:03:44.870924 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 120/227] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:44 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:45.898579 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-20ce26fd-b037-427f-824a-be31359b0f14 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:45.898579 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-20ce26fd-b037-427f-824a-be31359b0f14 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:45.905861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-20ce26fd-b037-427f-824a-be31359b0f14 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:45.906311 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-20ce26fd-b037-427f-824a-be31359b0f14 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:45.907424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-20ce26fd-b037-427f-824a-be31359b0f14 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:45.907864 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-20ce26fd-b037-427f-824a-be31359b0f14 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:46.088878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-20ce26fd-b037-427f-824a-be31359b0f14 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:46.101018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-20ce26fd-b037-427f-824a-be31359b0f14 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.209303 Jul 28 18:03:46.101484 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 108/228] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:45 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:47.125053 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bf76e596-5abe-44a7-9e2e-a4a9a5ff2e86 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:47.126553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bf76e596-5abe-44a7-9e2e-a4a9a5ff2e86 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:47.133716 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bf76e596-5abe-44a7-9e2e-a4a9a5ff2e86 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:47.134670 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bf76e596-5abe-44a7-9e2e-a4a9a5ff2e86 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:47.135613 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bf76e596-5abe-44a7-9e2e-a4a9a5ff2e86 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:47.136077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bf76e596-5abe-44a7-9e2e-a4a9a5ff2e86 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:47.352775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bf76e596-5abe-44a7-9e2e-a4a9a5ff2e86 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:47.360291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bf76e596-5abe-44a7-9e2e-a4a9a5ff2e86 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.239481 Jul 28 18:03:47.360858 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 121/229] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:47 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:48.381580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bcec1a1f-573e-4601-b058-3ab78a2c253b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:48.382161 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bcec1a1f-573e-4601-b058-3ab78a2c253b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:48.391427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bcec1a1f-573e-4601-b058-3ab78a2c253b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:48.391865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bcec1a1f-573e-4601-b058-3ab78a2c253b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:48.392621 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bcec1a1f-573e-4601-b058-3ab78a2c253b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:48.393050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bcec1a1f-573e-4601-b058-3ab78a2c253b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:48.533182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bcec1a1f-573e-4601-b058-3ab78a2c253b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:48.541238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bcec1a1f-573e-4601-b058-3ab78a2c253b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.163364 Jul 28 18:03:48.541798 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 109/230] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:48 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:49.562250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-39054c56-7b27-46a0-acd9-4ed5bb9a61b1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:49.562916 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-39054c56-7b27-46a0-acd9-4ed5bb9a61b1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:49.569440 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-39054c56-7b27-46a0-acd9-4ed5bb9a61b1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:49.569886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-39054c56-7b27-46a0-acd9-4ed5bb9a61b1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:49.570679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-39054c56-7b27-46a0-acd9-4ed5bb9a61b1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:49.571128 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-39054c56-7b27-46a0-acd9-4ed5bb9a61b1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:49.595242 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:03:49.710155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-39054c56-7b27-46a0-acd9-4ed5bb9a61b1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:49.720281 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-39054c56-7b27-46a0-acd9-4ed5bb9a61b1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.161822 Jul 28 18:03:49.721017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 122/231] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:49 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:50.745742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c37009ee-7659-45a4-b0f9-0dbcdad1743f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:50.747211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c37009ee-7659-45a4-b0f9-0dbcdad1743f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:50.754247 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c37009ee-7659-45a4-b0f9-0dbcdad1743f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:50.754742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c37009ee-7659-45a4-b0f9-0dbcdad1743f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:50.755527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c37009ee-7659-45a4-b0f9-0dbcdad1743f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:50.755964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c37009ee-7659-45a4-b0f9-0dbcdad1743f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:50.966385 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-541399581", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "networks": [{"uuid": "9deb3c13-2833-461f-adf7-1cc4897c90a6"}]}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:03:50.968289 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c37009ee-7659-45a4-b0f9-0dbcdad1743f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:50.976511 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c37009ee-7659-45a4-b0f9-0dbcdad1743f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.237619 Jul 28 18:03:50.977147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 110/232] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:50 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:51.027290 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] validate_networks() for [('9deb3c13-2833-461f-adf7-1cc4897c90a6', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:03:51.408163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:03:51.408583 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:03:51.409222 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:03:51.409854 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:03:51.410271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:03:51.421543 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:51.422005 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:51.422846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:51.423280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:51.441728 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Getting quotas for project 834ec9d4361246999cc4e822acaa6b77. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:03:51.445831 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Getting quotas for user 6c67d6fcda3f4a938b2728f7ce2fc3ea and project 834ec9d4361246999cc4e822acaa6b77. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:03:51.462031 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:03:51.462031 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:03:51.662658 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e011a43f-3994-4696-8983-1c6b5116fbdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700448 Jul 28 18:03:51.663292 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 123/233] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 18:03:51.675231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-238250c7-c2c4-42e6-ae8b-9049e3de7f55 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:51.675841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-238250c7-c2c4-42e6-ae8b-9049e3de7f55 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:51.738286 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-238250c7-c2c4-42e6-ae8b-9049e3de7f55 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:51.746475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-238250c7-c2c4-42e6-ae8b-9049e3de7f55 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1213 microversion: 2.1 time: 0.075011 Jul 28 18:03:51.747610 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 111/234] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:51 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:03:51.998867 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f6ab17ab-7941-4bb3-b875-394a77d6ebda tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:51.999541 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f6ab17ab-7941-4bb3-b875-394a77d6ebda tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:52.006191 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f6ab17ab-7941-4bb3-b875-394a77d6ebda tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:52.006676 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f6ab17ab-7941-4bb3-b875-394a77d6ebda tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:52.007449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f6ab17ab-7941-4bb3-b875-394a77d6ebda tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:52.007887 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f6ab17ab-7941-4bb3-b875-394a77d6ebda tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:52.164524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f6ab17ab-7941-4bb3-b875-394a77d6ebda tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:52.176944 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f6ab17ab-7941-4bb3-b875-394a77d6ebda tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.182378 Jul 28 18:03:52.177903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 124/235] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:51 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:52.767931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c4a00ca0-83e6-452c-9954-7f17d700e14d tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:52.768547 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c4a00ca0-83e6-452c-9954-7f17d700e14d tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:52.823499 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c4a00ca0-83e6-452c-9954-7f17d700e14d tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:52.833928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c4a00ca0-83e6-452c-9954-7f17d700e14d tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1213 microversion: 2.1 time: 0.069188 Jul 28 18:03:52.845563 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 112/236] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:52 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:53.198692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ad0e4d30-3671-45c1-8c7c-203ddba83a5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:53.199302 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ad0e4d30-3671-45c1-8c7c-203ddba83a5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:53.206579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ad0e4d30-3671-45c1-8c7c-203ddba83a5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:53.207029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ad0e4d30-3671-45c1-8c7c-203ddba83a5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:53.207805 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ad0e4d30-3671-45c1-8c7c-203ddba83a5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:53.208238 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ad0e4d30-3671-45c1-8c7c-203ddba83a5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:53.616754 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ad0e4d30-3671-45c1-8c7c-203ddba83a5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:53.625941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ad0e4d30-3671-45c1-8c7c-203ddba83a5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.431478 Jul 28 18:03:53.626679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 125/237] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:53 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:53.857322 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ffef9f39-4623-41c6-87b4-c80f13a2f525 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:53.857927 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ffef9f39-4623-41c6-87b4-c80f13a2f525 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:53.864061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ffef9f39-4623-41c6-87b4-c80f13a2f525 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:53.864508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ffef9f39-4623-41c6-87b4-c80f13a2f525 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:53.865274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ffef9f39-4623-41c6-87b4-c80f13a2f525 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:53.865703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ffef9f39-4623-41c6-87b4-c80f13a2f525 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:53.943578 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ffef9f39-4623-41c6-87b4-c80f13a2f525 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:53.951966 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ffef9f39-4623-41c6-87b4-c80f13a2f525 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1209 microversion: 2.1 time: 0.099619 Jul 28 18:03:53.952539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 113/238] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:53 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:54.648027 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-006ec1d8-73aa-4241-853e-734b10d5bcb7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:54.651116 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-006ec1d8-73aa-4241-853e-734b10d5bcb7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:54.659256 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-006ec1d8-73aa-4241-853e-734b10d5bcb7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:54.659936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-006ec1d8-73aa-4241-853e-734b10d5bcb7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:54.661465 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-006ec1d8-73aa-4241-853e-734b10d5bcb7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:54.662086 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-006ec1d8-73aa-4241-853e-734b10d5bcb7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:54.792092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-935bf722-c8fb-4a36-9bbb-8dd3048845d1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:54.792743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-935bf722-c8fb-4a36-9bbb-8dd3048845d1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:54.799175 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-935bf722-c8fb-4a36-9bbb-8dd3048845d1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:54.799952 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-935bf722-c8fb-4a36-9bbb-8dd3048845d1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:54.800864 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-935bf722-c8fb-4a36-9bbb-8dd3048845d1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:54.801804 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-935bf722-c8fb-4a36-9bbb-8dd3048845d1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:54.864005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-935bf722-c8fb-4a36-9bbb-8dd3048845d1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/ips" status: 200 len: 153 microversion: 2.20 time: 0.076193 Jul 28 18:03:54.866258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 114/239] 10.222.0.85 () {60 vars in 1289 bytes} [Thu Jul 28 18:03:54 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/ips => generated 153 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:03:54.959082 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-006ec1d8-73aa-4241-853e-734b10d5bcb7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:54.969339 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-006ec1d8-73aa-4241-853e-734b10d5bcb7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.326045 Jul 28 18:03:54.981738 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 126/240] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:54 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:54.986598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-717351c1-9563-4d9a-98b8-8e7ca154057f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:54.987307 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-717351c1-9563-4d9a-98b8-8e7ca154057f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:55.022926 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-717351c1-9563-4d9a-98b8-8e7ca154057f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:55.028289 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-717351c1-9563-4d9a-98b8-8e7ca154057f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:55.029427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-717351c1-9563-4d9a-98b8-8e7ca154057f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:55.029869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-717351c1-9563-4d9a-98b8-8e7ca154057f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:55.112093 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-717351c1-9563-4d9a-98b8-8e7ca154057f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:55.121660 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-717351c1-9563-4d9a-98b8-8e7ca154057f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1265 microversion: 2.1 time: 0.138417 Jul 28 18:03:55.122244 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 115/241] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:54 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:03:55.996924 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-56789814-0463-4fb8-990f-4ac7ec8e6f8e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:55.998212 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-56789814-0463-4fb8-990f-4ac7ec8e6f8e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:56.006050 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-56789814-0463-4fb8-990f-4ac7ec8e6f8e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:56.006527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-56789814-0463-4fb8-990f-4ac7ec8e6f8e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:56.008007 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-56789814-0463-4fb8-990f-4ac7ec8e6f8e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:56.008007 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-56789814-0463-4fb8-990f-4ac7ec8e6f8e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:56.142970 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-17eecb38-5968-4210-a909-8d85ee6c1752 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:56.143641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-17eecb38-5968-4210-a909-8d85ee6c1752 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:56.154257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-17eecb38-5968-4210-a909-8d85ee6c1752 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:56.154788 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-17eecb38-5968-4210-a909-8d85ee6c1752 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:56.156174 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-17eecb38-5968-4210-a909-8d85ee6c1752 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:56.156631 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-17eecb38-5968-4210-a909-8d85ee6c1752 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:56.233479 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-56789814-0463-4fb8-990f-4ac7ec8e6f8e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:56.250980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-56789814-0463-4fb8-990f-4ac7ec8e6f8e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.257725 Jul 28 18:03:56.252136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 127/242] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:55 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:56.273466 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-17eecb38-5968-4210-a909-8d85ee6c1752 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:56.281944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-17eecb38-5968-4210-a909-8d85ee6c1752 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1265 microversion: 2.1 time: 0.142706 Jul 28 18:03:56.282961 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 116/243] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:56 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:57.273076 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a81b1e59-7591-4c69-8a17-8e06c3285e0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:57.273605 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a81b1e59-7591-4c69-8a17-8e06c3285e0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:57.284659 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a81b1e59-7591-4c69-8a17-8e06c3285e0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:57.285112 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a81b1e59-7591-4c69-8a17-8e06c3285e0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:57.285946 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a81b1e59-7591-4c69-8a17-8e06c3285e0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:57.286513 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a81b1e59-7591-4c69-8a17-8e06c3285e0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:57.315115 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e72bdf6d-1063-4f90-9608-cb4204e249c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:57.318466 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e72bdf6d-1063-4f90-9608-cb4204e249c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:57.334745 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e72bdf6d-1063-4f90-9608-cb4204e249c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:57.338393 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e72bdf6d-1063-4f90-9608-cb4204e249c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:57.340543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e72bdf6d-1063-4f90-9608-cb4204e249c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:57.341302 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e72bdf6d-1063-4f90-9608-cb4204e249c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:57.470747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e72bdf6d-1063-4f90-9608-cb4204e249c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:57.498484 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e72bdf6d-1063-4f90-9608-cb4204e249c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1265 microversion: 2.1 time: 0.194480 Jul 28 18:03:57.500969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 117/244] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:57 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:57.599385 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a81b1e59-7591-4c69-8a17-8e06c3285e0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:57.607715 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a81b1e59-7591-4c69-8a17-8e06c3285e0f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.338693 Jul 28 18:03:57.608337 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 128/245] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:57 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:58.521889 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f934e056-b2da-4ba5-8877-5b824de3bb07 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:58.522562 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f934e056-b2da-4ba5-8877-5b824de3bb07 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:58.529471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f934e056-b2da-4ba5-8877-5b824de3bb07 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:58.530096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f934e056-b2da-4ba5-8877-5b824de3bb07 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:58.536975 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f934e056-b2da-4ba5-8877-5b824de3bb07 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:58.536975 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f934e056-b2da-4ba5-8877-5b824de3bb07 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:58.604785 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f934e056-b2da-4ba5-8877-5b824de3bb07 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:58.613039 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f934e056-b2da-4ba5-8877-5b824de3bb07 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1271 microversion: 2.1 time: 0.095134 Jul 28 18:03:58.613765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 118/246] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:58 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:58.629447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1762134b-a457-4ca1-9882-a3ba86a18fc6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:58.630155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1762134b-a457-4ca1-9882-a3ba86a18fc6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:58.637653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1762134b-a457-4ca1-9882-a3ba86a18fc6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:58.638099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1762134b-a457-4ca1-9882-a3ba86a18fc6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:58.638947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1762134b-a457-4ca1-9882-a3ba86a18fc6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:58.639546 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1762134b-a457-4ca1-9882-a3ba86a18fc6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:59.088850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1762134b-a457-4ca1-9882-a3ba86a18fc6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:59.099715 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1762134b-a457-4ca1-9882-a3ba86a18fc6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.474029 Jul 28 18:03:59.115896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 129/247] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:58 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:03:59.488927 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b8beadd4-ac00-4dfa-9b7f-f068598ecdab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:03:59.489598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b8beadd4-ac00-4dfa-9b7f-f068598ecdab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:59.504562 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b8beadd4-ac00-4dfa-9b7f-f068598ecdab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:59.505476 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b8beadd4-ac00-4dfa-9b7f-f068598ecdab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:59.506534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b8beadd4-ac00-4dfa-9b7f-f068598ecdab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:59.507950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b8beadd4-ac00-4dfa-9b7f-f068598ecdab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:59.572630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-b8beadd4-ac00-4dfa-9b7f-f068598ecdab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lazy-loading 'flavor' on Instance uuid 8f64c566-cf5d-4240-95e2-c5746a5bba89 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:03:59.638265 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-366121ab-1d25-4329-b708-1f39226c1b98 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:03:59.640763 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-366121ab-1d25-4329-b708-1f39226c1b98 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:03:59.655749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-366121ab-1d25-4329-b708-1f39226c1b98 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:59.656196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-366121ab-1d25-4329-b708-1f39226c1b98 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:59.656961 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-366121ab-1d25-4329-b708-1f39226c1b98 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:03:59.657387 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-366121ab-1d25-4329-b708-1f39226c1b98 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:03:59.813986 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-366121ab-1d25-4329-b708-1f39226c1b98 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:03:59.824868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-366121ab-1d25-4329-b708-1f39226c1b98 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1271 microversion: 2.1 time: 0.191586 Jul 28 18:03:59.826090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 130/248] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:03:59 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:00.121503 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a0f7f5cc-ad90-491d-8cdd-6ac8413e57a4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:00.122297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a0f7f5cc-ad90-491d-8cdd-6ac8413e57a4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:00.133104 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a0f7f5cc-ad90-491d-8cdd-6ac8413e57a4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:00.133104 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a0f7f5cc-ad90-491d-8cdd-6ac8413e57a4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:00.141331 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a0f7f5cc-ad90-491d-8cdd-6ac8413e57a4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:00.142284 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a0f7f5cc-ad90-491d-8cdd-6ac8413e57a4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:00.342483 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b8beadd4-ac00-4dfa-9b7f-f068598ecdab tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/action" status: 202 len: 0 microversion: 2.20 time: 0.857507 Jul 28 18:04:00.343471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 119/249] 10.222.0.85 () {62 vars in 1319 bytes} [Thu Jul 28 18:03:59 2022] POST /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:04:00.353180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:00.354262 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:00.362420 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:00.363378 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:00.364620 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:00.365275 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:00.390770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a0f7f5cc-ad90-491d-8cdd-6ac8413e57a4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:00.406858 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a0f7f5cc-ad90-491d-8cdd-6ac8413e57a4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.283084 Jul 28 18:04:00.409747 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 131/250] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:00 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:00.615313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:00.630679 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:00.635635 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:00.638852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1b114b66-053c-4d37-b198-cad2da81a849 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.290722 Jul 28 18:04:00.643123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 120/251] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:00 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:00.865077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c657cb18-febd-4e67-809f-84045dd0bd28 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:00.865077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c657cb18-febd-4e67-809f-84045dd0bd28 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:00.865077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c657cb18-febd-4e67-809f-84045dd0bd28 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:00.865077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c657cb18-febd-4e67-809f-84045dd0bd28 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:00.865898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c657cb18-febd-4e67-809f-84045dd0bd28 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:00.865898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c657cb18-febd-4e67-809f-84045dd0bd28 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:01.088024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c657cb18-febd-4e67-809f-84045dd0bd28 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:01.119092 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c657cb18-febd-4e67-809f-84045dd0bd28 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.274818 Jul 28 18:04:01.122620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 132/252] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:00 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:01.435972 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5c5e1013-4db4-4843-bbb1-a1aa292a7f81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:01.436656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5c5e1013-4db4-4843-bbb1-a1aa292a7f81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:01.451415 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5c5e1013-4db4-4843-bbb1-a1aa292a7f81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:01.452068 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5c5e1013-4db4-4843-bbb1-a1aa292a7f81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:01.453113 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5c5e1013-4db4-4843-bbb1-a1aa292a7f81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:01.453765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5c5e1013-4db4-4843-bbb1-a1aa292a7f81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:01.670287 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:01.674468 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=6 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:01.676736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:01.677298 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:01.696984 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5c5e1013-4db4-4843-bbb1-a1aa292a7f81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:01.704866 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5c5e1013-4db4-4843-bbb1-a1aa292a7f81 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.273477 Jul 28 18:04:01.705441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 121/253] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:01 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:01.714856 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:01.714856 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:01.714856 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:01.714856 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:01.978010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-75c5827d-1e89-446e-8aaa-519e523d507f req-0602e97e-4766-4588-aa7e-838631cc1375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad79ec17-9b38-48a9-b21a-51ee6c1a4a27", "tag": "1a8789b3-5499-4e64-b9d6-674552b7dcae"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:02.002244 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-75c5827d-1e89-446e-8aaa-519e523d507f req-0602e97e-4766-4588-aa7e-838631cc1375 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:02.002244 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-75c5827d-1e89-446e-8aaa-519e523d507f req-0602e97e-4766-4588-aa7e-838631cc1375 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:02.031969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-75c5827d-1e89-446e-8aaa-519e523d507f req-0602e97e-4766-4588-aa7e-838631cc1375 service nova] Creating event network-changed:1a8789b3-5499-4e64-b9d6-674552b7dcae for instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 on hv-cinder-83754 Jul 28 18:04:02.037370 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-75c5827d-1e89-446e-8aaa-519e523d507f req-0602e97e-4766-4588-aa7e-838631cc1375 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064339 Jul 28 18:04:02.039041 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 122/254] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:04:02.144812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1f225b7c-44d6-4c9a-abb5-fc4c8c4b19e2 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:02.146126 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1f225b7c-44d6-4c9a-abb5-fc4c8c4b19e2 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:02.151105 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:02.162149 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f225b7c-44d6-4c9a-abb5-fc4c8c4b19e2 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:02.163667 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f225b7c-44d6-4c9a-abb5-fc4c8c4b19e2 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:02.163796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:02.165329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:02.165539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f225b7c-44d6-4c9a-abb5-fc4c8c4b19e2 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:02.166026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f225b7c-44d6-4c9a-abb5-fc4c8c4b19e2 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:02.171971 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a1aca9a4-5bfb-4c36-a0ca-87d4ce8cd83b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.502399 Jul 28 18:04:02.172929 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 133/255] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:01 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:02.206705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:02.418227 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1f225b7c-44d6-4c9a-abb5-fc4c8c4b19e2 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:02.426455 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1f225b7c-44d6-4c9a-abb5-fc4c8c4b19e2 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.286627 Jul 28 18:04:02.435895 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 123/256] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:02 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:02.734368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b9ef1954-bd3f-440a-bef9-3ef7271ec3d6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:02.735108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b9ef1954-bd3f-440a-bef9-3ef7271ec3d6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:02.743365 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b9ef1954-bd3f-440a-bef9-3ef7271ec3d6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:02.743850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b9ef1954-bd3f-440a-bef9-3ef7271ec3d6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:02.744589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b9ef1954-bd3f-440a-bef9-3ef7271ec3d6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:02.745200 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b9ef1954-bd3f-440a-bef9-3ef7271ec3d6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:02.947615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b9ef1954-bd3f-440a-bef9-3ef7271ec3d6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:02.996415 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b9ef1954-bd3f-440a-bef9-3ef7271ec3d6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.266425 Jul 28 18:04:02.998823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 134/257] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:02 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:03.196857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:03.197435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:03.202304 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=4 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:03.205833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:03.206403 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:03.207053 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:03.207644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:03.409737 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:03.418684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:03.423046 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:03.424306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-17424406-41cb-4919-b80e-3c3326236c47 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.232574 Jul 28 18:04:03.439002 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 124/258] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:03 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:03.447398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d0801fe3-3818-47c4-9ad6-cc27ff6ffca7 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:03.448405 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d0801fe3-3818-47c4-9ad6-cc27ff6ffca7 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:03.457614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d0801fe3-3818-47c4-9ad6-cc27ff6ffca7 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:03.457614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d0801fe3-3818-47c4-9ad6-cc27ff6ffca7 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:03.458234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d0801fe3-3818-47c4-9ad6-cc27ff6ffca7 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:03.458691 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d0801fe3-3818-47c4-9ad6-cc27ff6ffca7 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:03.663326 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d0801fe3-3818-47c4-9ad6-cc27ff6ffca7 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:03.672926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d0801fe3-3818-47c4-9ad6-cc27ff6ffca7 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.229602 Jul 28 18:04:03.673550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 135/259] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:03 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:04.018105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5e144a6d-cbce-4c30-a097-7c2dfcc5d7e2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:04.018697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5e144a6d-cbce-4c30-a097-7c2dfcc5d7e2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:04.037997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5e144a6d-cbce-4c30-a097-7c2dfcc5d7e2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:04.037997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5e144a6d-cbce-4c30-a097-7c2dfcc5d7e2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:04.037997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5e144a6d-cbce-4c30-a097-7c2dfcc5d7e2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:04.037997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5e144a6d-cbce-4c30-a097-7c2dfcc5d7e2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:04.240076 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5e144a6d-cbce-4c30-a097-7c2dfcc5d7e2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:04.240076 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5e144a6d-cbce-4c30-a097-7c2dfcc5d7e2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.163868 Jul 28 18:04:04.240076 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 125/260] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:04 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:04.455124 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:04.456615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:04.463642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:04.465721 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:04.466773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:04.467848 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:04.468674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:04.700111 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-35e65a9c-d56b-46bb-9574-f465ce375937 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:04.702413 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-35e65a9c-d56b-46bb-9574-f465ce375937 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:04.707751 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=54 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:04.729624 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-35e65a9c-d56b-46bb-9574-f465ce375937 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:04.730472 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-35e65a9c-d56b-46bb-9574-f465ce375937 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:04.733063 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-35e65a9c-d56b-46bb-9574-f465ce375937 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:04.734510 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-35e65a9c-d56b-46bb-9574-f465ce375937 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:04.821400 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:04.835648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:04.840987 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:04.855786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7c8b57ea-11d4-42fa-9e71-8787d6244acc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.406772 Jul 28 18:04:04.856400 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 136/261] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:04 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:04.959477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-35e65a9c-d56b-46bb-9574-f465ce375937 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:04.969182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-35e65a9c-d56b-46bb-9574-f465ce375937 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.278419 Jul 28 18:04:04.979208 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 126/262] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:04 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:05.229528 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ab5ac482-ca09-4a1c-8305-1b1ffb27cda2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:05.230215 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ab5ac482-ca09-4a1c-8305-1b1ffb27cda2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:05.239899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab5ac482-ca09-4a1c-8305-1b1ffb27cda2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.244312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab5ac482-ca09-4a1c-8305-1b1ffb27cda2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.244312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab5ac482-ca09-4a1c-8305-1b1ffb27cda2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.244312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab5ac482-ca09-4a1c-8305-1b1ffb27cda2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.549773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ab5ac482-ca09-4a1c-8305-1b1ffb27cda2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:05.558550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ab5ac482-ca09-4a1c-8305-1b1ffb27cda2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1501 microversion: 2.1 time: 0.334229 Jul 28 18:04:05.559461 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 137/263] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:05 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:05.581251 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c6c02d1-1576-4644-92e3-a83394a6a2a1"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:05.584092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:05.593501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.594419 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.601756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.601756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.637734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] HTTP exception thrown: Cannot 'attach_volume' instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 while it is in vm_state rescued Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Request method failure captured: Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: POST /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15/os-volume_attachments HTTP/1.1 Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 74 Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8bdDylPe9TzYYahsE2YdUv8fsr0QRGbahEgRDZbkgtzcrOP3v03mdQwiM6MCmMl9eZdEVy4s00YMO7-3K7iXOaF5PeoG1oWSwvHUFyfpf5uOSXYen8iGBgKIrZ6fIcZity5LUFiDlgE-llaLEg0RohnQWVYBqmOcX-k2IkRZtnZgk Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:04:05.643475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c1c1587cf20d427e8bb03ffae1b1ce33", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 564e0f9000a1448ea9ea37a2892e6495 Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {"volumeAttachment": {"volumeId": "0c6c02d1-1576-4644-92e3-a83394a6a2a1"}} Jul 28 18:04:05.645035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Cannot 'attach_volume' instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 while it is in vm_state rescued Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'server_id': 'e09c2f70-20f1-4762-b7ea-36d9ef650f15', 'body': {'volumeAttachment': {'volumeId': '0c6c02d1-1576-4644-92e3-a83394a6a2a1'}}} Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:04:05.646169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 while it is in vm_state rescued Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:04:05.647683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:04:05.651258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:04:05.651258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:04:05.651258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 while it is in vm_state rescued Jul 28 18:04:05.651258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:05.651258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Returning 409 to user: Cannot 'attach_volume' instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 while it is in vm_state rescued {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:04:05.651258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fe71c7dd-f7a3-473f-9356-4516d2740127 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068007 Jul 28 18:04:05.651258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 127/264] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:04:05 2022] POST /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 18:04:05.657192 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e6a27ebb-6ee1-4503-bc48-571968067664 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:05.657835 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e6a27ebb-6ee1-4503-bc48-571968067664 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:05.664550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e6a27ebb-6ee1-4503-bc48-571968067664 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.666790 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e6a27ebb-6ee1-4503-bc48-571968067664 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.667775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e6a27ebb-6ee1-4503-bc48-571968067664 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.668555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e6a27ebb-6ee1-4503-bc48-571968067664 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.848423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:05.889754 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:05.890602 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:05.909280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.909280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.909280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.909280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.935524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e6a27ebb-6ee1-4503-bc48-571968067664 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15/action" status: 202 len: 0 microversion: 2.1 time: 0.283561 Jul 28 18:04:05.937811 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 138/265] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:04:05 2022] POST /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:04:05.953242 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ec013cff-1787-47e0-a899-a424661f390d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:05.953946 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ec013cff-1787-47e0-a899-a424661f390d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:05.980689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec013cff-1787-47e0-a899-a424661f390d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.981143 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec013cff-1787-47e0-a899-a424661f390d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:05.981928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec013cff-1787-47e0-a899-a424661f390d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:05.982375 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec013cff-1787-47e0-a899-a424661f390d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:06.117008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:06.128426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:06.129936 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:06.131341 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4c446a90-114b-496a-8961-f0caf73409e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.246480 Jul 28 18:04:06.132234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 128/266] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:05 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:06.144581 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-344b1bb7-38d6-4f2a-9a3f-7d0dd40bc000 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:06.145286 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-344b1bb7-38d6-4f2a-9a3f-7d0dd40bc000 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:06.160078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-344b1bb7-38d6-4f2a-9a3f-7d0dd40bc000 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:06.160519 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-344b1bb7-38d6-4f2a-9a3f-7d0dd40bc000 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:06.161578 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-344b1bb7-38d6-4f2a-9a3f-7d0dd40bc000 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:06.162667 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-344b1bb7-38d6-4f2a-9a3f-7d0dd40bc000 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:06.411173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-344b1bb7-38d6-4f2a-9a3f-7d0dd40bc000 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:06.420899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-344b1bb7-38d6-4f2a-9a3f-7d0dd40bc000 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.286898 Jul 28 18:04:06.435069 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 129/267] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:06 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:06.661169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ec013cff-1787-47e0-a899-a424661f390d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:06.674332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ec013cff-1787-47e0-a899-a424661f390d tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1509 microversion: 2.1 time: 0.733360 Jul 28 18:04:06.675764 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 139/268] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:05 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1509 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:07.155507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:07.156196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:07.169222 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:07.170091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:07.171788 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:07.172232 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:07.353476 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:07.366298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:07.366298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:07.367838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e7fa23d8-a609-4653-8102-670921f8deae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.215852 Jul 28 18:04:07.368486 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 130/269] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:07 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:07.446066 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2e058e9a-36d9-4607-a602-3f50378003fe tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:07.447229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2e058e9a-36d9-4607-a602-3f50378003fe tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:07.455228 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2e058e9a-36d9-4607-a602-3f50378003fe tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:07.455945 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2e058e9a-36d9-4607-a602-3f50378003fe tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:07.456898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2e058e9a-36d9-4607-a602-3f50378003fe tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:07.457704 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2e058e9a-36d9-4607-a602-3f50378003fe tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:07.698588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4c60bc57-497a-4811-9e42-8f6a49e067d5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:07.699866 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4c60bc57-497a-4811-9e42-8f6a49e067d5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:07.712090 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c60bc57-497a-4811-9e42-8f6a49e067d5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:07.715851 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c60bc57-497a-4811-9e42-8f6a49e067d5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:07.719300 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c60bc57-497a-4811-9e42-8f6a49e067d5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:07.720900 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2e058e9a-36d9-4607-a602-3f50378003fe tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:07.721962 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c60bc57-497a-4811-9e42-8f6a49e067d5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:07.729044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2e058e9a-36d9-4607-a602-3f50378003fe tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.287792 Jul 28 18:04:07.754924 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 140/270] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:07 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:08.184589 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4c60bc57-497a-4811-9e42-8f6a49e067d5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:08.193227 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4c60bc57-497a-4811-9e42-8f6a49e067d5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1509 microversion: 2.1 time: 0.500008 Jul 28 18:04:08.193813 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 131/271] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:07 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:08.391851 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:08.392579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:08.406975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:08.409731 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:08.411529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:08.415182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:08.758503 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d1b151c3-f9e1-430d-a484-631456f3136b tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:08.760739 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d1b151c3-f9e1-430d-a484-631456f3136b tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:08.773313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1b151c3-f9e1-430d-a484-631456f3136b tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:08.775248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1b151c3-f9e1-430d-a484-631456f3136b tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:08.779660 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1b151c3-f9e1-430d-a484-631456f3136b tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:08.780653 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1b151c3-f9e1-430d-a484-631456f3136b tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:09.009981 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:09.019577 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:09.021246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:09.022558 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9d1e70bb-9314-4c8e-a4bd-fcc1ab2eb05d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.634994 Jul 28 18:04:09.023441 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 141/272] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:08 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:09.215710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6aded640-d4e4-44e2-a9d4-6297d18d501c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:09.216492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6aded640-d4e4-44e2-a9d4-6297d18d501c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:09.242294 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6aded640-d4e4-44e2-a9d4-6297d18d501c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:09.243836 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6aded640-d4e4-44e2-a9d4-6297d18d501c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:09.244777 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6aded640-d4e4-44e2-a9d4-6297d18d501c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:09.245990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6aded640-d4e4-44e2-a9d4-6297d18d501c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:09.294506 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d1b151c3-f9e1-430d-a484-631456f3136b tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:09.314333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d1b151c3-f9e1-430d-a484-631456f3136b tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.551085 Jul 28 18:04:09.316098 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 132/273] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:08 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:09.451204 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6aded640-d4e4-44e2-a9d4-6297d18d501c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:09.468504 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6aded640-d4e4-44e2-a9d4-6297d18d501c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1509 microversion: 2.1 time: 0.256509 Jul 28 18:04:09.483827 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 142/274] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:09 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:10.046862 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:10.049211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:10.069905 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:10.072182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:10.072182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:10.072182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:10.297355 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:10.312516 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:10.318553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:10.322718 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-23383406-7854-4634-8a76-6102ebd2e27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.279172 Jul 28 18:04:10.337650 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 133/275] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:10 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:10.342791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-63e00989-5a90-4595-b5cd-7e74d0acc442 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:10.343408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-63e00989-5a90-4595-b5cd-7e74d0acc442 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:10.367794 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-63e00989-5a90-4595-b5cd-7e74d0acc442 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:10.372157 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-63e00989-5a90-4595-b5cd-7e74d0acc442 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:10.373487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-63e00989-5a90-4595-b5cd-7e74d0acc442 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:10.374104 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-63e00989-5a90-4595-b5cd-7e74d0acc442 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:10.494500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-305bc595-b2d9-438e-a610-006e8d581407 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:10.503442 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-305bc595-b2d9-438e-a610-006e8d581407 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:10.520192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-305bc595-b2d9-438e-a610-006e8d581407 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:10.521580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-305bc595-b2d9-438e-a610-006e8d581407 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:10.525351 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-305bc595-b2d9-438e-a610-006e8d581407 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:10.526054 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-305bc595-b2d9-438e-a610-006e8d581407 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:10.657837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-63e00989-5a90-4595-b5cd-7e74d0acc442 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:10.682149 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-63e00989-5a90-4595-b5cd-7e74d0acc442 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.348890 Jul 28 18:04:10.682775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 143/276] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:10 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:10.834474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-305bc595-b2d9-438e-a610-006e8d581407 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:10.856774 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-305bc595-b2d9-438e-a610-006e8d581407 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1509 microversion: 2.1 time: 0.369321 Jul 28 18:04:10.857931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 134/277] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:10 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1509 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:11.350721 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:11.352257 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:11.358876 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:11.359319 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:11.360090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:11.360551 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:11.567944 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:11.580315 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:11.584864 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:11.588969 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-016aad7b-ce0c-41d7-a04a-7f41b1d74909 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.242670 Jul 28 18:04:11.591574 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 144/278] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:11 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:11.708104 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0c94a8e7-9f3d-4fe2-87bb-90c1fa522a91 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:11.708894 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0c94a8e7-9f3d-4fe2-87bb-90c1fa522a91 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:11.725098 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0c94a8e7-9f3d-4fe2-87bb-90c1fa522a91 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:11.727090 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0c94a8e7-9f3d-4fe2-87bb-90c1fa522a91 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:11.728366 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0c94a8e7-9f3d-4fe2-87bb-90c1fa522a91 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:11.729017 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0c94a8e7-9f3d-4fe2-87bb-90c1fa522a91 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:11.878732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2021ab78-adee-44a3-866e-624bc31a7a5b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:11.879515 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2021ab78-adee-44a3-866e-624bc31a7a5b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:11.887366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2021ab78-adee-44a3-866e-624bc31a7a5b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:11.887813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2021ab78-adee-44a3-866e-624bc31a7a5b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:11.888759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2021ab78-adee-44a3-866e-624bc31a7a5b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:11.889191 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2021ab78-adee-44a3-866e-624bc31a7a5b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:11.931237 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0c94a8e7-9f3d-4fe2-87bb-90c1fa522a91 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:11.944793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0c94a8e7-9f3d-4fe2-87bb-90c1fa522a91 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.241569 Jul 28 18:04:11.946859 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 135/279] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:11 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:12.108235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2021ab78-adee-44a3-866e-624bc31a7a5b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:12.118487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2021ab78-adee-44a3-866e-624bc31a7a5b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1515 microversion: 2.1 time: 0.242600 Jul 28 18:04:12.135692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 145/280] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:11 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1515 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:12.613782 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:12.615019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:12.627482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:12.630597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:12.631505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:12.632045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:12.982177 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f732ebbe-8013-4341-b866-d6728a1d0a22 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:12.986606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f732ebbe-8013-4341-b866-d6728a1d0a22 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:13.018589 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:13.027510 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f732ebbe-8013-4341-b866-d6728a1d0a22 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:13.039625 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f732ebbe-8013-4341-b866-d6728a1d0a22 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:13.044935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f732ebbe-8013-4341-b866-d6728a1d0a22 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:13.049183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:13.051784 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f732ebbe-8013-4341-b866-d6728a1d0a22 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:13.056193 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:13.058956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-05f4cf0f-c9e7-4f84-b4bf-78d717a51c58 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.449055 Jul 28 18:04:13.078967 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 136/281] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:12 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:13.396771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f732ebbe-8013-4341-b866-d6728a1d0a22 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:13.413190 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f732ebbe-8013-4341-b866-d6728a1d0a22 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.443315 Jul 28 18:04:13.441646 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 146/282] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:12 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:14.101843 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:14.108148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:14.146045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:14.149696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:14.150539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:14.151029 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:14.442567 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e8383700-bb9f-4e7c-ab2e-7a5e0031347f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:14.443836 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e8383700-bb9f-4e7c-ab2e-7a5e0031347f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:14.453673 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e8383700-bb9f-4e7c-ab2e-7a5e0031347f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:14.454474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e8383700-bb9f-4e7c-ab2e-7a5e0031347f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:14.455414 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e8383700-bb9f-4e7c-ab2e-7a5e0031347f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:14.456151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e8383700-bb9f-4e7c-ab2e-7a5e0031347f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:14.519697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:14.547744 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:14.562312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:14.566536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-26855309-48dd-4063-81e4-4334cc706233 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.481292 Jul 28 18:04:14.571258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 137/283] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:14 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:14.925927 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e8383700-bb9f-4e7c-ab2e-7a5e0031347f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:14.940148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-75a226c6-e702-4afb-906e-d05e0326eb83 req-03e047b6-171e-4e9f-9440-e9f9235d1dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad79ec17-9b38-48a9-b21a-51ee6c1a4a27", "name": "network-vif-plugged", "status": "completed", "tag": "1a8789b3-5499-4e64-b9d6-674552b7dcae"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:14.940859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e8383700-bb9f-4e7c-ab2e-7a5e0031347f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.505762 Jul 28 18:04:14.942457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 147/284] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:14 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:14.956586 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-75a226c6-e702-4afb-906e-d05e0326eb83 req-03e047b6-171e-4e9f-9440-e9f9235d1dc0 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:14.958584 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-75a226c6-e702-4afb-906e-d05e0326eb83 req-03e047b6-171e-4e9f-9440-e9f9235d1dc0 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:15.002590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-75a226c6-e702-4afb-906e-d05e0326eb83 req-03e047b6-171e-4e9f-9440-e9f9235d1dc0 service nova] Creating event network-vif-plugged:1a8789b3-5499-4e64-b9d6-674552b7dcae for instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 on hv-cinder-83754 Jul 28 18:04:15.011455 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-75a226c6-e702-4afb-906e-d05e0326eb83 req-03e047b6-171e-4e9f-9440-e9f9235d1dc0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080722 Jul 28 18:04:15.014483 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 138/285] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:15.406710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e93c4f95-6a8a-4ed4-9363-aaf72046e9f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'create', calling method: .version_select at 0x7fdae045c4c0>, body: {"keypair": {"name": "tempest-keypair-2009658400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3t7RT4L7Uw0dQTpeGcdv98WAyZfhEt3zJj8MPcUutVDfMImSU74P/CpI7v3HEGigDng4JLx1EntAa6+LhwRdKwpuVAqRvNknaX8QIpI6t8fbHg7YN89bRs0jYoLMIYPQ=="}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:15.474025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-e93c4f95-6a8a-4ed4-9363-aaf72046e9f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Getting quotas for project c1c1587cf20d427e8bb03ffae1b1ce33. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:04:15.480661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-e93c4f95-6a8a-4ed4-9363-aaf72046e9f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Getting quotas for user 564e0f9000a1448ea9ea37a2892e6495 and project c1c1587cf20d427e8bb03ffae1b1ce33. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:04:15.583347 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e93c4f95-6a8a-4ed4-9363-aaf72046e9f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189296 Jul 28 18:04:15.586164 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 148/286] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:04:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:15.605556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:15.606314 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:15.614222 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:15.615137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:15.616389 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:15.618003 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:15.943726 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:15.968772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4f6e0b1d-71c0-4907-95ad-ed598db2117e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:15.971071 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4f6e0b1d-71c0-4907-95ad-ed598db2117e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:15.971194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:15.971487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:15.979155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-eb08997c-62e5-4fed-aa07-9f0aa9492882 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.380561 Jul 28 18:04:15.994649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 139/287] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:15 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:15.999381 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4f6e0b1d-71c0-4907-95ad-ed598db2117e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:15.999381 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4f6e0b1d-71c0-4907-95ad-ed598db2117e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:15.999381 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4f6e0b1d-71c0-4907-95ad-ed598db2117e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:16.002381 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4f6e0b1d-71c0-4907-95ad-ed598db2117e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:16.354139 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4f6e0b1d-71c0-4907-95ad-ed598db2117e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:16.371704 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4f6e0b1d-71c0-4907-95ad-ed598db2117e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1313 microversion: 2.1 time: 0.400862 Jul 28 18:04:16.373637 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 149/288] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:15 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:17.003867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:17.007797 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:17.011224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:17.012063 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:17.013009 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:17.013602 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:17.172610 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:17.183597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:17.185276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:17.186986 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1df890f8-3b76-4d19-a9b7-d8cb922d3a7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.186978 Jul 28 18:04:17.188199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 140/289] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:16 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:17.393149 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6258e67a-a190-4700-8c01-e1735992032a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:17.393929 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6258e67a-a190-4700-8c01-e1735992032a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:17.409030 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6258e67a-a190-4700-8c01-e1735992032a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:17.409369 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6258e67a-a190-4700-8c01-e1735992032a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:17.410213 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6258e67a-a190-4700-8c01-e1735992032a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:17.410697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6258e67a-a190-4700-8c01-e1735992032a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:17.823048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6258e67a-a190-4700-8c01-e1735992032a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:17.833563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6258e67a-a190-4700-8c01-e1735992032a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1497 microversion: 2.1 time: 0.444231 Jul 28 18:04:17.836321 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 150/290] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:17 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1497 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:18.230503 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:18.231873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:18.240783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:18.242443 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:18.243917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:18.254865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:18.262958 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:18.407779 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:18.416730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:18.418238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:18.419441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-89aa801e-feb1-44d2-88dc-c1c406778df9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.194078 Jul 28 18:04:18.420128 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 141/291] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:18 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:19.374954 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-595794488", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d1691a3-9020-429a-9c4e-b3ff2213b5a2"}], "security_groups": [{"name": "tempest-securitygroup--1991045155"}], "key_name": "tempest-keypair-2009658400", "user_data": "}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:19.448333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:19.448938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:19.456091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:19.456538 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:19.457624 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:19.458280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:19.516979 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] validate_networks() for [('3d1691a3-9020-429a-9c4e-b3ff2213b5a2', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:04:19.676883 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:19.691019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:19.693126 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:19.695396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-33aaad01-ba81-49b7-997b-d4fb46d1828a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.251075 Jul 28 18:04:19.709998 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 142/292] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:19 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:20.050204 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:04:20.052607 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-70297b74-77df-4a3c-8070-405c4b9feb1f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:20.052734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:04:20.052830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-70297b74-77df-4a3c-8070-405c4b9feb1f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:20.052932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:04:20.052932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:04:20.052932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:04:20.063449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:20.064153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:20.064574 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-70297b74-77df-4a3c-8070-405c4b9feb1f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:20.065094 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-70297b74-77df-4a3c-8070-405c4b9feb1f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:20.065669 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:20.065919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-70297b74-77df-4a3c-8070-405c4b9feb1f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:20.066380 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-70297b74-77df-4a3c-8070-405c4b9feb1f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:20.066706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:20.087783 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Getting quotas for project c1c1587cf20d427e8bb03ffae1b1ce33. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:04:20.095172 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Getting quotas for user 564e0f9000a1448ea9ea37a2892e6495 and project c1c1587cf20d427e8bb03ffae1b1ce33. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:04:20.104548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-70297b74-77df-4a3c-8070-405c4b9feb1f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:04:20.109599 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:04:20.112385 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:04:20.299126 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cc74f7dc-2a2c-4707-a3fe-476839f1c813 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.927505 Jul 28 18:04:20.300589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 151/293] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:04:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:04:20.311609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0b8752f5-9942-46b0-8402-f567871a5ebc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:20.312707 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0b8752f5-9942-46b0-8402-f567871a5ebc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:20.474718 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0b8752f5-9942-46b0-8402-f567871a5ebc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:20.499293 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0b8752f5-9942-46b0-8402-f567871a5ebc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1245 microversion: 2.1 time: 0.179656 Jul 28 18:04:20.499943 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 152/294] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:20 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1245 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:20.567338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-70297b74-77df-4a3c-8070-405c4b9feb1f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 204 len: 0 microversion: 2.1 time: 0.522075 Jul 28 18:04:20.569629 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 143/295] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:04:20 2022] DELETE /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:04:20.579617 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-138f011e-69ae-4354-8f96-ed04d756eb02 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:20.580840 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-138f011e-69ae-4354-8f96-ed04d756eb02 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:20.587602 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-138f011e-69ae-4354-8f96-ed04d756eb02 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:20.588339 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-138f011e-69ae-4354-8f96-ed04d756eb02 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:20.590193 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-138f011e-69ae-4354-8f96-ed04d756eb02 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:20.590948 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-138f011e-69ae-4354-8f96-ed04d756eb02 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:20.725175 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:20.726655 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:20.734021 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:20.748826 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:20.750338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:20.753247 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:20.763877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-138f011e-69ae-4354-8f96-ed04d756eb02 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:20.774216 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-138f011e-69ae-4354-8f96-ed04d756eb02 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1503 microversion: 2.1 time: 0.200125 Jul 28 18:04:20.774665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 153/296] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:20 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:21.049258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:21.064634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:21.069259 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:21.071756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ef894881-ef11-491d-8f8c-742a8f951688 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.351493 Jul 28 18:04:21.073151 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 144/297] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:20 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:21.526487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9dcb8286-4d8a-4c4b-b3a3-65f8fd5f92e7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:21.528194 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9dcb8286-4d8a-4c4b-b3a3-65f8fd5f92e7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:21.538363 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9dcb8286-4d8a-4c4b-b3a3-65f8fd5f92e7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:21.539274 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9dcb8286-4d8a-4c4b-b3a3-65f8fd5f92e7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:21.540389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9dcb8286-4d8a-4c4b-b3a3-65f8fd5f92e7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:21.541026 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9dcb8286-4d8a-4c4b-b3a3-65f8fd5f92e7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:21.629236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9dcb8286-4d8a-4c4b-b3a3-65f8fd5f92e7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:21.642948 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9dcb8286-4d8a-4c4b-b3a3-65f8fd5f92e7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1249 microversion: 2.1 time: 0.121139 Jul 28 18:04:21.645694 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 154/298] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:21 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1249 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:21.801036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4d154ff6-7b05-4601-b7af-9ae1350afdef tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:21.802496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4d154ff6-7b05-4601-b7af-9ae1350afdef tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:21.821404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d154ff6-7b05-4601-b7af-9ae1350afdef tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:21.823115 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d154ff6-7b05-4601-b7af-9ae1350afdef tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:21.825090 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d154ff6-7b05-4601-b7af-9ae1350afdef tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:21.826207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d154ff6-7b05-4601-b7af-9ae1350afdef tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:22.104751 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4d154ff6-7b05-4601-b7af-9ae1350afdef tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:22.104751 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4d154ff6-7b05-4601-b7af-9ae1350afdef tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1503 microversion: 2.1 time: 0.279181 Jul 28 18:04:22.104751 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 145/299] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:21 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:22.105025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:22.105025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:22.110084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:22.110999 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:22.116300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:22.116300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:22.363333 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:22.379280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:22.384439 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:22.391265 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4116ddfd-9e6c-43dd-9f98-f2b4f39549ca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.297717 Jul 28 18:04:22.391869 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 155/300] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:22 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:22.666239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f68e49c0-ce0d-4b15-a149-5df02b79a92c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:22.667045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f68e49c0-ce0d-4b15-a149-5df02b79a92c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:22.673238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f68e49c0-ce0d-4b15-a149-5df02b79a92c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:22.673753 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f68e49c0-ce0d-4b15-a149-5df02b79a92c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:22.674666 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f68e49c0-ce0d-4b15-a149-5df02b79a92c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:22.675371 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f68e49c0-ce0d-4b15-a149-5df02b79a92c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:22.930870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f68e49c0-ce0d-4b15-a149-5df02b79a92c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:22.938522 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f68e49c0-ce0d-4b15-a149-5df02b79a92c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1249 microversion: 2.1 time: 0.277217 Jul 28 18:04:22.939086 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 146/301] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:22 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1249 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:23.104850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-111c2d3b-8f8c-4f7c-979a-04abc4732bdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:23.105473 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-111c2d3b-8f8c-4f7c-979a-04abc4732bdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:23.114605 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-111c2d3b-8f8c-4f7c-979a-04abc4732bdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:23.115535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-111c2d3b-8f8c-4f7c-979a-04abc4732bdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:23.117084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-111c2d3b-8f8c-4f7c-979a-04abc4732bdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:23.120180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-111c2d3b-8f8c-4f7c-979a-04abc4732bdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:23.186554 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-d6f5abd7-4684-4927-bcb1-a74475cd03ef req-c33d9855-5411-46ce-ab25-3e2b7a121c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad79ec17-9b38-48a9-b21a-51ee6c1a4a27", "name": "network-vif-deleted", "tag": "1a8789b3-5499-4e64-b9d6-674552b7dcae"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:23.208714 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-d6f5abd7-4684-4927-bcb1-a74475cd03ef req-c33d9855-5411-46ce-ab25-3e2b7a121c32 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:23.208845 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-d6f5abd7-4684-4927-bcb1-a74475cd03ef req-c33d9855-5411-46ce-ab25-3e2b7a121c32 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:23.240613 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-d6f5abd7-4684-4927-bcb1-a74475cd03ef req-c33d9855-5411-46ce-ab25-3e2b7a121c32 service nova] Creating event network-vif-deleted:1a8789b3-5499-4e64-b9d6-674552b7dcae for instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 on hv-cinder-83754 Jul 28 18:04:23.277732 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-d6f5abd7-4684-4927-bcb1-a74475cd03ef req-c33d9855-5411-46ce-ab25-3e2b7a121c32 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086169 Jul 28 18:04:23.281630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 147/302] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:04:23.310858 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-111c2d3b-8f8c-4f7c-979a-04abc4732bdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:23.320666 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-111c2d3b-8f8c-4f7c-979a-04abc4732bdd tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1461 microversion: 2.1 time: 0.220320 Jul 28 18:04:23.327628 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 156/303] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:23 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1461 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:23.426783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:23.426783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:23.433486 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:23.434261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:23.435571 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:23.436748 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:23.776955 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:23.789336 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:23.794281 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:23.795913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1c6cc1f7-5aa9-43dc-81b5-f1704eb4f118 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1745 microversion: 2.20 time: 0.381673 Jul 28 18:04:23.810522 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 148/304] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:23 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1745 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:23.962958 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a5165e0a-5ac8-489d-80b6-c27b26f08547 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:23.964217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a5165e0a-5ac8-489d-80b6-c27b26f08547 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:23.971888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5165e0a-5ac8-489d-80b6-c27b26f08547 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:23.972575 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5165e0a-5ac8-489d-80b6-c27b26f08547 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:23.974049 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5165e0a-5ac8-489d-80b6-c27b26f08547 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:23.974852 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5165e0a-5ac8-489d-80b6-c27b26f08547 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:24.129050 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a5165e0a-5ac8-489d-80b6-c27b26f08547 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:24.142462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a5165e0a-5ac8-489d-80b6-c27b26f08547 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1297 microversion: 2.1 time: 0.185326 Jul 28 18:04:24.143233 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 157/305] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:23 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1297 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:24.351779 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:24.352587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:24.368557 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:24.372212 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:24.372212 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:24.375041 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:24.466707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:24.467156 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:24.467607 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lazy-loading 'fault' on Instance uuid ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:04:24.604367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:24.620187 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a0fb4f4b-c05d-44a0-b4a8-b2e5d7bd29c6 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 200 len: 1303 microversion: 2.1 time: 0.268736 Jul 28 18:04:24.640389 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 149/306] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:24 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 1303 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:24.823397 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:24.824392 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:24.860545 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:24.864996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:24.870241 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:24.871302 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:24.884589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:25.173391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6146fc1e-3878-4a4b-8a46-e8e2c25856bd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:25.177147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6146fc1e-3878-4a4b-8a46-e8e2c25856bd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:25.190666 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6146fc1e-3878-4a4b-8a46-e8e2c25856bd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:25.191880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6146fc1e-3878-4a4b-8a46-e8e2c25856bd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:25.196393 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6146fc1e-3878-4a4b-8a46-e8e2c25856bd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:25.198570 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6146fc1e-3878-4a4b-8a46-e8e2c25856bd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:25.361977 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6146fc1e-3878-4a4b-8a46-e8e2c25856bd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:25.385618 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6146fc1e-3878-4a4b-8a46-e8e2c25856bd tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1315 microversion: 2.1 time: 0.208689 Jul 28 18:04:25.389022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 150/307] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:25 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:25.611889 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:25.628511 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:25.630864 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:25.633959 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b848d2db-a318-4c86-9058-86e885ce1420 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1745 microversion: 2.20 time: 0.816414 Jul 28 18:04:25.635077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 158/308] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:24 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1745 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:25.648265 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:25.648914 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: ad79ec17-9b38-48a9-b21a-51ee6c1a4a27] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:25.660115 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:25.662733 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:25.662733 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:25.662733 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:25.689319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] HTTP exception thrown: Instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 could not be found. Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Request method failure captured: Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 HTTP/1.1 Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s-DhZs0fYRnEd4a_zuCEYZUkIxQ-dHC1nlr7fHMQAIQjcjwET4s0ZXDHUvH_ienE3xIOB6dd7zwqx_dxqxy6dTTEu_HJe1HUnP4bFOqnkNR4RRojPonGow6LtQfwH72HtLNFZOCwtzTqjfQeinUk6cYZgCkqC9_MT4v3Rg0BrsxJcs Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 834ec9d4361246999cc4e822acaa6b77 Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-VolumesActionsTest-310885223 Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:04:25.700220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/834ec9d4361246999cc4e822acaa6b77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_834ec9d4361246999cc4e822acaa6b77", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/834ec9d4361246999cc4e822acaa6b77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/834ec9d4361246999cc4e822acaa6b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-VolumesActionsTest-310885223 Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 834ec9d4361246999cc4e822acaa6b77 Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-VolumesActionsTest-310885223 Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-VolumesActionsTest-310885223-project Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 6c67d6fcda3f4a938b2728f7ce2fc3ea Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-VolumesActionsTest-310885223-project Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 could not be found. Jul 28 18:04:25.701693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'ad79ec17-9b38-48a9-b21a-51ee6c1a4a27'} Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 could not be found. Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:04:25.702487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 could not be found. Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 could not be found. Jul 28 18:04:25.703750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:04:25.706722 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Returning 404 to user: Instance ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:04:25.706722 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3b5bf271-bdd4-4a0d-83fd-d7f52a1f6774 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27" status: 404 len: 111 microversion: 2.1 time: 0.057975 Jul 28 18:04:25.720308 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 151/309] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:25 2022] GET /compute/v2.1/servers/ad79ec17-9b38-48a9-b21a-51ee6c1a4a27 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:04:25.946018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-369094127", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "networks": [{"uuid": "9deb3c13-2833-461f-adf7-1cc4897c90a6"}]}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:26.330454 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] validate_networks() for [('9deb3c13-2833-461f-adf7-1cc4897c90a6', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:04:26.410315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-aa0623ef-c407-4b26-800c-e2230f7ae187 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:26.410927 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-aa0623ef-c407-4b26-800c-e2230f7ae187 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:26.425765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa0623ef-c407-4b26-800c-e2230f7ae187 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:26.426711 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa0623ef-c407-4b26-800c-e2230f7ae187 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:26.427589 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa0623ef-c407-4b26-800c-e2230f7ae187 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:26.428061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa0623ef-c407-4b26-800c-e2230f7ae187 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:26.553297 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-aa0623ef-c407-4b26-800c-e2230f7ae187 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:26.566616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-aa0623ef-c407-4b26-800c-e2230f7ae187 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1303 microversion: 2.1 time: 0.159478 Jul 28 18:04:26.581363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 152/310] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:26 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:26.657184 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:26.658314 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:26.670033 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:26.670944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:26.673103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:26.674788 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:26.937655 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:26.947841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:26.953044 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:26.954663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-700add04-9bab-46ca-b0d0-d837c2097167 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.301135 Jul 28 18:04:26.958777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 153/311] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:26 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:26.974513 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-6bc8a0cf-25ad-4bb1-a0e4-bf8cade5c948 req-8d30a75a-7c14-4889-a5b4-c438267bd68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f64c566-cf5d-4240-95e2-c5746a5bba89", "name": "network-vif-plugged", "status": "completed", "tag": "8980c8f3-7810-4b7b-b88d-1b866e291a34"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:26.992113 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-6bc8a0cf-25ad-4bb1-a0e4-bf8cade5c948 req-8d30a75a-7c14-4889-a5b4-c438267bd68b service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:26.992552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-6bc8a0cf-25ad-4bb1-a0e4-bf8cade5c948 req-8d30a75a-7c14-4889-a5b4-c438267bd68b service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:27.041609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-6bc8a0cf-25ad-4bb1-a0e4-bf8cade5c948 req-8d30a75a-7c14-4889-a5b4-c438267bd68b service nova] Creating event network-vif-plugged:8980c8f3-7810-4b7b-b88d-1b866e291a34 for instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 on hv-cinder-83754 Jul 28 18:04:27.058643 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-6bc8a0cf-25ad-4bb1-a0e4-bf8cade5c948 req-8d30a75a-7c14-4889-a5b4-c438267bd68b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097377 Jul 28 18:04:27.060116 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 154/312] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:27.337291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:04:27.337784 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:04:27.338492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:04:27.339014 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:04:27.339653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:04:27.356801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:27.357435 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:27.358330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:27.358985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:27.402476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Getting quotas for project 834ec9d4361246999cc4e822acaa6b77. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:04:27.408030 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Getting quotas for user 6c67d6fcda3f4a938b2728f7ce2fc3ea and project 834ec9d4361246999cc4e822acaa6b77. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:04:27.421791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:04:27.424570 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:04:27.605786 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a596b5ec-2872-4e74-969d-b5ca97e15d3f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:27.609951 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a596b5ec-2872-4e74-969d-b5ca97e15d3f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:27.639783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a596b5ec-2872-4e74-969d-b5ca97e15d3f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:27.642121 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a596b5ec-2872-4e74-969d-b5ca97e15d3f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:27.660855 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-17842e83-849f-4f6c-8565-f801092e0294 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724158 Jul 28 18:04:27.662655 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a596b5ec-2872-4e74-969d-b5ca97e15d3f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:27.663806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a596b5ec-2872-4e74-969d-b5ca97e15d3f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:27.666150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 159/313] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:04:27.688096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b5794b94-02c0-424e-be9a-1fc24e13af68 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:27.692100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b5794b94-02c0-424e-be9a-1fc24e13af68 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:27.977706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b5794b94-02c0-424e-be9a-1fc24e13af68 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:27.996154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b5794b94-02c0-424e-be9a-1fc24e13af68 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1213 microversion: 2.1 time: 0.320919 Jul 28 18:04:28.012391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 160/314] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:27 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1213 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:28.020865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:28.042160 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:28.107681 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:28.117399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a596b5ec-2872-4e74-969d-b5ca97e15d3f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:28.126313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:28.134006 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:28.148029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:28.209501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a596b5ec-2872-4e74-969d-b5ca97e15d3f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.624862 Jul 28 18:04:28.235496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 155/315] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:27 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:28.634662 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:28.654247 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:28.656256 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:28.658948 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8ab105fc-d43e-48e0-baeb-77944e98940f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.656976 Jul 28 18:04:28.683719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 161/316] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:27 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:29.018528 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1196e9d0-e550-4aa4-bc93-851533c39692 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:29.020313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1196e9d0-e550-4aa4-bc93-851533c39692 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:29.095481 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1196e9d0-e550-4aa4-bc93-851533c39692 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:29.105081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1196e9d0-e550-4aa4-bc93-851533c39692 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1213 microversion: 2.1 time: 0.090028 Jul 28 18:04:29.106212 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 156/317] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:29 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:29.234250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-734c4b77-73d1-40b6-a6e8-60405f104f0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:29.235389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-734c4b77-73d1-40b6-a6e8-60405f104f0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:29.260597 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-734c4b77-73d1-40b6-a6e8-60405f104f0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:29.260597 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-734c4b77-73d1-40b6-a6e8-60405f104f0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:29.261483 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-734c4b77-73d1-40b6-a6e8-60405f104f0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:29.261936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-734c4b77-73d1-40b6-a6e8-60405f104f0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:29.690435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:29.695310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:29.716545 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:29.719029 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:29.719029 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:29.719029 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:29.842786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-734c4b77-73d1-40b6-a6e8-60405f104f0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:29.857762 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-734c4b77-73d1-40b6-a6e8-60405f104f0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.627170 Jul 28 18:04:29.858692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 162/318] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:29 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:30.068608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:30.096076 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:30.097582 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:30.114532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1f8dd75f-868f-44bc-acd0-1646bb74fffe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.426951 Jul 28 18:04:30.134388 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 157/319] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:29 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:30.134626 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8fa0dddc-e2fe-4512-8234-18210a189f94 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:30.134626 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8fa0dddc-e2fe-4512-8234-18210a189f94 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:30.143851 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8fa0dddc-e2fe-4512-8234-18210a189f94 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:30.148766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8fa0dddc-e2fe-4512-8234-18210a189f94 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:30.152147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8fa0dddc-e2fe-4512-8234-18210a189f94 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:30.155802 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8fa0dddc-e2fe-4512-8234-18210a189f94 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:30.380376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-076d0c1f-4ab9-45ff-adfc-0b3740a03d2d req-e98130a6-3dcf-4679-935c-4f082ebc7552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dd071c-f443-4fbc-a37c-0b8b250968a4", "tag": "9f9562ad-51bd-4d8e-b76b-7edbbe736d9f"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:30.403905 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-076d0c1f-4ab9-45ff-adfc-0b3740a03d2d req-e98130a6-3dcf-4679-935c-4f082ebc7552 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:30.404843 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-076d0c1f-4ab9-45ff-adfc-0b3740a03d2d req-e98130a6-3dcf-4679-935c-4f082ebc7552 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:30.407195 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8fa0dddc-e2fe-4512-8234-18210a189f94 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:30.421651 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-076d0c1f-4ab9-45ff-adfc-0b3740a03d2d req-e98130a6-3dcf-4679-935c-4f082ebc7552 service nova] Creating event network-changed:9f9562ad-51bd-4d8e-b76b-7edbbe736d9f for instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 on hv-cinder-83754 Jul 28 18:04:30.426699 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8fa0dddc-e2fe-4512-8234-18210a189f94 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1217 microversion: 2.1 time: 0.303945 Jul 28 18:04:30.443877 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-076d0c1f-4ab9-45ff-adfc-0b3740a03d2d req-e98130a6-3dcf-4679-935c-4f082ebc7552 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069778 Jul 28 18:04:30.447000 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 163/320] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:30 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1217 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:30.447606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 158/321] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:04:30.883253 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-50e74b01-33e9-4ead-a3ff-304a6eb6de62 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:30.884488 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-50e74b01-33e9-4ead-a3ff-304a6eb6de62 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:30.893523 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:30.897479 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-50e74b01-33e9-4ead-a3ff-304a6eb6de62 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:30.898555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-50e74b01-33e9-4ead-a3ff-304a6eb6de62 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:30.904575 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-50e74b01-33e9-4ead-a3ff-304a6eb6de62 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:30.904575 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-50e74b01-33e9-4ead-a3ff-304a6eb6de62 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:31.156746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:31.157495 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:31.182660 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:31.186742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:31.187855 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:31.190395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:31.234973 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:31.337541 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-50e74b01-33e9-4ead-a3ff-304a6eb6de62 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:31.346369 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-50e74b01-33e9-4ead-a3ff-304a6eb6de62 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.467723 Jul 28 18:04:31.346927 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 164/322] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:30 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:31.354447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1185d8d6-df9b-4483-981c-9fdcada7b676 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Action: 'create', calling method: .version_select at 0x7fdae04315e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1321978075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9byYKuql4yEBEx0TM+S1cvZgO6Nol6DY2X2qVWDzOaEuKw6O8yZ1FMkaERUne/Uba3LPdNtPjNK6vMDC2Sq/zAu4Na0ZapeVVeR2s7QuZrxP+bVaqfuQu3KrKryLb4Lg=="}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:31.373324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-1185d8d6-df9b-4483-981c-9fdcada7b676 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Getting quotas for project 39115160ca364b2590af12fccde98256. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:04:31.381313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-1185d8d6-df9b-4483-981c-9fdcada7b676 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Getting quotas for user 78888cc145ba4052be05b1c321de44fd and project 39115160ca364b2590af12fccde98256. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:04:31.432043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:31.441196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:31.441482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:31.443060 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7a7fd980-9bf4-4cfd-9563-27b5ff431ad1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.296944 Jul 28 18:04:31.458749 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 159/323] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:31 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:31.464896 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2a93288c-6c8d-427e-8863-90eb6fe8d92c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:31.465509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2a93288c-6c8d-427e-8863-90eb6fe8d92c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:31.472031 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a93288c-6c8d-427e-8863-90eb6fe8d92c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:31.472730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a93288c-6c8d-427e-8863-90eb6fe8d92c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:31.473515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a93288c-6c8d-427e-8863-90eb6fe8d92c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:31.474247 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a93288c-6c8d-427e-8863-90eb6fe8d92c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:31.497820 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1185d8d6-df9b-4483-981c-9fdcada7b676 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.148592 Jul 28 18:04:31.498986 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 165/324] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:04:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:31.596789 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2a93288c-6c8d-427e-8863-90eb6fe8d92c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:31.608109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2a93288c-6c8d-427e-8863-90eb6fe8d92c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1265 microversion: 2.1 time: 0.147589 Jul 28 18:04:31.612889 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 160/325] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:31 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:31.707429 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-189363908", "imageRef": "638d668b-a6c0-4bb5-a8e2-251838a1e2d2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1321978075", "networks": [{"uuid": "56f2c9ab-e91c-46e4-9b59-419fd7ae7e9a"}]}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:31.901050 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] validate_networks() for [('56f2c9ab-e91c-46e4-9b59-419fd7ae7e9a', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:04:32.368803 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-feb28f30-c071-4ff2-b902-0bc081ee6505 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:32.369412 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-feb28f30-c071-4ff2-b902-0bc081ee6505 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:32.379718 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-feb28f30-c071-4ff2-b902-0bc081ee6505 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:32.384123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-feb28f30-c071-4ff2-b902-0bc081ee6505 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:32.385012 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-feb28f30-c071-4ff2-b902-0bc081ee6505 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:32.387531 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-feb28f30-c071-4ff2-b902-0bc081ee6505 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:32.597886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:04:32.598548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:04:32.599080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:04:32.599493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:04:32.599911 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:04:32.637466 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:32.642769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:32.644127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:32.644573 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:32.687236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Getting quotas for project 39115160ca364b2590af12fccde98256. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:04:32.690550 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-feb28f30-c071-4ff2-b902-0bc081ee6505 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:32.692879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Getting quotas for user 78888cc145ba4052be05b1c321de44fd and project 39115160ca364b2590af12fccde98256. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:04:32.717681 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-feb28f30-c071-4ff2-b902-0bc081ee6505 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.352107 Jul 28 18:04:32.719599 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 161/326] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:32 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:32.783691 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:32.783691 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:32.784641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:04:32.784879 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:32.784879 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:32.784879 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:32.784879 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:32.785160 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='638d668b-a6c0-4bb5-a8e2-251838a1e2d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:04:32.907402 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:32.915970 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:32.917452 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:32.918650 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ccd11b0e-695d-488a-ad05-d1ae3aebda19 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.197514 Jul 28 18:04:32.919199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 162/327] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:32 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:32.923721 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bb1fa570-2df3-466b-b982-cad8d84b8f74 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:32.924313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bb1fa570-2df3-466b-b982-cad8d84b8f74 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:32.931275 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bb1fa570-2df3-466b-b982-cad8d84b8f74 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:32.931709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bb1fa570-2df3-466b-b982-cad8d84b8f74 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:32.932458 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bb1fa570-2df3-466b-b982-cad8d84b8f74 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:32.932882 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bb1fa570-2df3-466b-b982-cad8d84b8f74 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:33.018732 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bb1fa570-2df3-466b-b982-cad8d84b8f74 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:33.026306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bb1fa570-2df3-466b-b982-cad8d84b8f74 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1283 microversion: 2.1 time: 0.106133 Jul 28 18:04:33.026893 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 163/328] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:32 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1283 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:33.275845 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c37a2386-2ab9-489e-8282-b36ad5bcf803 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.575786 Jul 28 18:04:33.276953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 166/329] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:04:33.302581 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-62fab685-d334-4595-a0bd-e179393ba644 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:33.307837 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-62fab685-d334-4595-a0bd-e179393ba644 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:33.396639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-62fab685-d334-4595-a0bd-e179393ba644 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:33.409566 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-62fab685-d334-4595-a0bd-e179393ba644 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1258 microversion: 2.1 time: 0.113573 Jul 28 18:04:33.409910 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 164/330] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:33 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1258 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:33.750885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7f6aa5a8-e6a8-49a6-8c07-516866259593 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:33.750885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7f6aa5a8-e6a8-49a6-8c07-516866259593 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:33.761915 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7f6aa5a8-e6a8-49a6-8c07-516866259593 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:33.762975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7f6aa5a8-e6a8-49a6-8c07-516866259593 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:33.763936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7f6aa5a8-e6a8-49a6-8c07-516866259593 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:33.764480 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7f6aa5a8-e6a8-49a6-8c07-516866259593 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:33.949780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:33.951043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:33.959940 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7f6aa5a8-e6a8-49a6-8c07-516866259593 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:33.969346 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7f6aa5a8-e6a8-49a6-8c07-516866259593 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.224109 Jul 28 18:04:33.970513 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 167/331] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:33 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:33.970647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:33.971072 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:33.972231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:33.972725 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:34.048894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c049e2f1-76e3-4278-af92-a8a6347e62f0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:34.049940 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c049e2f1-76e3-4278-af92-a8a6347e62f0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:34.058467 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c049e2f1-76e3-4278-af92-a8a6347e62f0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:34.063398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c049e2f1-76e3-4278-af92-a8a6347e62f0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:34.063398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c049e2f1-76e3-4278-af92-a8a6347e62f0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:34.063398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c049e2f1-76e3-4278-af92-a8a6347e62f0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:34.138947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c049e2f1-76e3-4278-af92-a8a6347e62f0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:34.152236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c049e2f1-76e3-4278-af92-a8a6347e62f0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1283 microversion: 2.1 time: 0.102776 Jul 28 18:04:34.153152 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 168/332] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:34 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:34.215295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:34.224637 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:34.226507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:34.228006 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4c9c349b-5ab6-4891-9d9f-4fbce412623b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.289630 Jul 28 18:04:34.228570 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 165/333] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:33 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:34.434112 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ad0ffec7-571e-4a43-8ee9-e83b0496ad57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:34.434749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ad0ffec7-571e-4a43-8ee9-e83b0496ad57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:34.519394 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ad0ffec7-571e-4a43-8ee9-e83b0496ad57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:34.535594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ad0ffec7-571e-4a43-8ee9-e83b0496ad57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1258 microversion: 2.1 time: 0.107443 Jul 28 18:04:34.550535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 169/334] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:34 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1258 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:34.995811 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8fb91e49-1dd5-42ea-81ca-a528a5c36a0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:34.997308 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8fb91e49-1dd5-42ea-81ca-a528a5c36a0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:35.011444 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fb91e49-1dd5-42ea-81ca-a528a5c36a0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:35.012196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fb91e49-1dd5-42ea-81ca-a528a5c36a0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:35.013908 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fb91e49-1dd5-42ea-81ca-a528a5c36a0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:35.015389 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fb91e49-1dd5-42ea-81ca-a528a5c36a0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:35.175298 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1c0d05ee-e714-40fe-a75b-03d43aa178ca tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:35.176236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1c0d05ee-e714-40fe-a75b-03d43aa178ca tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:35.191120 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1c0d05ee-e714-40fe-a75b-03d43aa178ca tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:35.191760 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1c0d05ee-e714-40fe-a75b-03d43aa178ca tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:35.192547 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1c0d05ee-e714-40fe-a75b-03d43aa178ca tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:35.193285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1c0d05ee-e714-40fe-a75b-03d43aa178ca tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:35.318251 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1c0d05ee-e714-40fe-a75b-03d43aa178ca tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:35.344823 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8fb91e49-1dd5-42ea-81ca-a528a5c36a0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:35.357272 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1c0d05ee-e714-40fe-a75b-03d43aa178ca tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1271 microversion: 2.1 time: 0.183858 Jul 28 18:04:35.375692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 170/335] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:35 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1271 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:35.382428 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8fb91e49-1dd5-42ea-81ca-a528a5c36a0c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.388070 Jul 28 18:04:35.384320 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 166/336] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:34 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:35.388386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:35.389267 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:35.400467 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:35.402321 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:35.403510 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:35.404312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:35.562329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2f82a711-ef48-4bbc-9896-c573af7a0942 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:35.563543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2f82a711-ef48-4bbc-9896-c573af7a0942 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:35.582448 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2f82a711-ef48-4bbc-9896-c573af7a0942 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:35.589203 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2f82a711-ef48-4bbc-9896-c573af7a0942 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:35.590781 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2f82a711-ef48-4bbc-9896-c573af7a0942 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:35.596500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2f82a711-ef48-4bbc-9896-c573af7a0942 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:35.682910 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:35.708670 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:35.722248 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:35.723123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c839e272-8294-46f8-9399-bc212e21f3cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.346407 Jul 28 18:04:35.724259 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 171/337] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:35 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:35.742603 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2f82a711-ef48-4bbc-9896-c573af7a0942 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:35.752747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2f82a711-ef48-4bbc-9896-c573af7a0942 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1254 microversion: 2.1 time: 0.198085 Jul 28 18:04:35.767302 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 167/338] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:35 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1254 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:36.386923 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6505d1e5-6aba-4129-b9a6-9daef33afa23 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:36.387630 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6505d1e5-6aba-4129-b9a6-9daef33afa23 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:36.406611 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6505d1e5-6aba-4129-b9a6-9daef33afa23 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:36.407749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6505d1e5-6aba-4129-b9a6-9daef33afa23 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:36.407942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e05b9780-4ae9-47e2-8879-dfdd659ccaa9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:36.409140 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e05b9780-4ae9-47e2-8879-dfdd659ccaa9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:36.412311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6505d1e5-6aba-4129-b9a6-9daef33afa23 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:36.412788 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6505d1e5-6aba-4129-b9a6-9daef33afa23 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:36.418559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:36.420518 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e05b9780-4ae9-47e2-8879-dfdd659ccaa9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:36.421834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e05b9780-4ae9-47e2-8879-dfdd659ccaa9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:36.423706 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e05b9780-4ae9-47e2-8879-dfdd659ccaa9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:36.424353 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e05b9780-4ae9-47e2-8879-dfdd659ccaa9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:36.754383 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e05b9780-4ae9-47e2-8879-dfdd659ccaa9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:36.766071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e05b9780-4ae9-47e2-8879-dfdd659ccaa9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.362008 Jul 28 18:04:36.769413 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 168/339] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:36 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:36.773902 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:36.774624 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:36.781913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:36.785606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:36.785606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:36.785606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:36.996460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:37.010957 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:37.014323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:37.015582 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1ba50636-fb6b-4f7d-8537-007a6a42f0dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.246553 Jul 28 18:04:37.028501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 169/340] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:36 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:37.062193 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-54ea9ad3-5322-48e0-aa1b-7e2fd5714e33 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:37.082431 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-54ea9ad3-5322-48e0-aa1b-7e2fd5714e33 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:37.091026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-54ea9ad3-5322-48e0-aa1b-7e2fd5714e33 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:37.091026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-54ea9ad3-5322-48e0-aa1b-7e2fd5714e33 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:37.091551 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-54ea9ad3-5322-48e0-aa1b-7e2fd5714e33 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:37.092238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-54ea9ad3-5322-48e0-aa1b-7e2fd5714e33 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:37.166968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-54ea9ad3-5322-48e0-aa1b-7e2fd5714e33 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:37.197507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-54ea9ad3-5322-48e0-aa1b-7e2fd5714e33 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1310 microversion: 2.1 time: 0.174626 Jul 28 18:04:37.197507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 170/341] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:37 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1310 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:37.330235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6505d1e5-6aba-4129-b9a6-9daef33afa23 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:37.338877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6505d1e5-6aba-4129-b9a6-9daef33afa23 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.957664 Jul 28 18:04:37.339535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 172/342] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:36 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:37.788483 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a9006937-cbbc-4d09-83e9-2963672809d2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:37.789085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a9006937-cbbc-4d09-83e9-2963672809d2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:37.795463 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a9006937-cbbc-4d09-83e9-2963672809d2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:37.795908 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a9006937-cbbc-4d09-83e9-2963672809d2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:37.796673 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a9006937-cbbc-4d09-83e9-2963672809d2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:37.797103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a9006937-cbbc-4d09-83e9-2963672809d2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:37.978726 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a9006937-cbbc-4d09-83e9-2963672809d2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:38.000445 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a9006937-cbbc-4d09-83e9-2963672809d2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.206107 Jul 28 18:04:38.003252 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 171/343] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:37 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:38.065530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:38.066033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:38.075495 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:38.076430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:38.081127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:38.081774 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:38.214477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0c2a1da5-a0aa-49ae-ae4d-8e7b3e93e26b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:38.215669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0c2a1da5-a0aa-49ae-ae4d-8e7b3e93e26b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:38.227894 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0c2a1da5-a0aa-49ae-ae4d-8e7b3e93e26b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:38.228746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0c2a1da5-a0aa-49ae-ae4d-8e7b3e93e26b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:38.229790 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0c2a1da5-a0aa-49ae-ae4d-8e7b3e93e26b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:38.231013 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0c2a1da5-a0aa-49ae-ae4d-8e7b3e93e26b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:38.333044 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0c2a1da5-a0aa-49ae-ae4d-8e7b3e93e26b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:38.341968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0c2a1da5-a0aa-49ae-ae4d-8e7b3e93e26b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1310 microversion: 2.1 time: 0.131632 Jul 28 18:04:38.342964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 172/344] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:38 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:38.363085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e29c898d-146f-4138-a028-a07e7f65c290 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:38.367171 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e29c898d-146f-4138-a028-a07e7f65c290 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:38.379156 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e29c898d-146f-4138-a028-a07e7f65c290 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:38.383019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e29c898d-146f-4138-a028-a07e7f65c290 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:38.384120 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e29c898d-146f-4138-a028-a07e7f65c290 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:38.384753 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e29c898d-146f-4138-a028-a07e7f65c290 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:38.537636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:38.552351 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:38.570811 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:38.577915 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6fc0d706-5b8b-432c-87e1-6a7cc530c7c2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.516593 Jul 28 18:04:38.585155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 173/345] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:38 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:38.652324 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e29c898d-146f-4138-a028-a07e7f65c290 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:38.663346 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e29c898d-146f-4138-a028-a07e7f65c290 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.305780 Jul 28 18:04:38.666430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 173/346] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:38 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:38.946682 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-8078fc8a-f55f-4526-ae70-be7898ae2176 req-8d32ffa6-42cb-4f75-86b3-ab2846565b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae762fd-1a0b-48e7-891f-8555a4624c57", "tag": "de56644a-cd04-4c51-a8f8-1f45ca90a5a8"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:38.966048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-8078fc8a-f55f-4526-ae70-be7898ae2176 req-8d32ffa6-42cb-4f75-86b3-ab2846565b5c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:38.979955 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-8078fc8a-f55f-4526-ae70-be7898ae2176 req-8d32ffa6-42cb-4f75-86b3-ab2846565b5c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.016141 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3fe47a67-d6bb-4b05-9add-6f504991110e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:39.016777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3fe47a67-d6bb-4b05-9add-6f504991110e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:39.029982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3fe47a67-d6bb-4b05-9add-6f504991110e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:39.033705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3fe47a67-d6bb-4b05-9add-6f504991110e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.034913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3fe47a67-d6bb-4b05-9add-6f504991110e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:39.035515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3fe47a67-d6bb-4b05-9add-6f504991110e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.049941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-8078fc8a-f55f-4526-ae70-be7898ae2176 req-8d32ffa6-42cb-4f75-86b3-ab2846565b5c service nova] Creating event network-changed:de56644a-cd04-4c51-a8f8-1f45ca90a5a8 for instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 on hv-cinder-83754 Jul 28 18:04:39.082927 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-8078fc8a-f55f-4526-ae70-be7898ae2176 req-8d32ffa6-42cb-4f75-86b3-ab2846565b5c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121909 Jul 28 18:04:39.088358 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 174/347] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:04:39.266591 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-3fe47a67-d6bb-4b05-9add-6f504991110e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:39.285580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3fe47a67-d6bb-4b05-9add-6f504991110e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.267550 Jul 28 18:04:39.300123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 174/348] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:39 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:39.363911 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8670fd35-09fc-42af-93c4-b7b1a4a80762 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:39.366771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8670fd35-09fc-42af-93c4-b7b1a4a80762 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:39.382692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8670fd35-09fc-42af-93c4-b7b1a4a80762 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:39.383912 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8670fd35-09fc-42af-93c4-b7b1a4a80762 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.388429 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8670fd35-09fc-42af-93c4-b7b1a4a80762 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:39.389234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8670fd35-09fc-42af-93c4-b7b1a4a80762 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.576020 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8670fd35-09fc-42af-93c4-b7b1a4a80762 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:39.589136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8670fd35-09fc-42af-93c4-b7b1a4a80762 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1310 microversion: 2.1 time: 0.229611 Jul 28 18:04:39.590300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 175/349] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:39 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1310 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:39.605559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:39.606597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:39.626474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:39.627268 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.632755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:39.633404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.686381 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-85b99792-f307-4ee2-80cd-56bd0eb4ef7f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:39.687137 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-85b99792-f307-4ee2-80cd-56bd0eb4ef7f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:39.696021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-85b99792-f307-4ee2-80cd-56bd0eb4ef7f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:39.703132 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-85b99792-f307-4ee2-80cd-56bd0eb4ef7f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.704029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-85b99792-f307-4ee2-80cd-56bd0eb4ef7f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:39.704481 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-85b99792-f307-4ee2-80cd-56bd0eb4ef7f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:39.947614 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:39.966292 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:39.968042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:39.977923 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ee554d7d-a1f2-4d16-834d-3e1ed9dff647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.375107 Jul 28 18:04:39.997604 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 175/350] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:39 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:40.310856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-954a11a1-e057-47ab-9687-59cc7a01c67b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:40.312279 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-954a11a1-e057-47ab-9687-59cc7a01c67b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:40.316067 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-85b99792-f307-4ee2-80cd-56bd0eb4ef7f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:40.325745 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-85b99792-f307-4ee2-80cd-56bd0eb4ef7f tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.643603 Jul 28 18:04:40.327989 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-954a11a1-e057-47ab-9687-59cc7a01c67b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:40.330404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-954a11a1-e057-47ab-9687-59cc7a01c67b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:40.331396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 176/351] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:39 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:40.334884 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-954a11a1-e057-47ab-9687-59cc7a01c67b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:40.335403 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-954a11a1-e057-47ab-9687-59cc7a01c67b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:40.619562 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e7421be7-7acf-4faa-acc9-6e70ba59d512 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:40.620294 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e7421be7-7acf-4faa-acc9-6e70ba59d512 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:40.623496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-954a11a1-e057-47ab-9687-59cc7a01c67b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:40.632285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7421be7-7acf-4faa-acc9-6e70ba59d512 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:40.633132 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-954a11a1-e057-47ab-9687-59cc7a01c67b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.326529 Jul 28 18:04:40.633689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7421be7-7acf-4faa-acc9-6e70ba59d512 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:40.633829 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 176/352] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:40 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:40.636066 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7421be7-7acf-4faa-acc9-6e70ba59d512 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:40.641428 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7421be7-7acf-4faa-acc9-6e70ba59d512 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:41.002462 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:41.008257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:41.019820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:41.020490 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:41.021643 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:41.022818 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:41.033660 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:41.307445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e7421be7-7acf-4faa-acc9-6e70ba59d512 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:41.331054 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e7421be7-7acf-4faa-acc9-6e70ba59d512 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1316 microversion: 2.1 time: 0.718010 Jul 28 18:04:41.331673 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 177/353] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:40 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:41.372057 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b250a2f7-a2a7-4d13-b275-90e74f100849 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:41.373071 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b250a2f7-a2a7-4d13-b275-90e74f100849 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:41.377496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:41.392817 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:41.398367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:41.400433 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-497a81c2-be6d-4184-9687-e837697f1001 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.405075 Jul 28 18:04:41.419173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 177/354] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:40 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:41.429616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b250a2f7-a2a7-4d13-b275-90e74f100849 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:41.429616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b250a2f7-a2a7-4d13-b275-90e74f100849 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:41.429616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b250a2f7-a2a7-4d13-b275-90e74f100849 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:41.429616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b250a2f7-a2a7-4d13-b275-90e74f100849 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:41.654299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-91545044-da32-4269-b378-6bb0fced41c8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:41.654956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-91545044-da32-4269-b378-6bb0fced41c8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:41.666225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-91545044-da32-4269-b378-6bb0fced41c8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:41.666723 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-91545044-da32-4269-b378-6bb0fced41c8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:41.668492 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-91545044-da32-4269-b378-6bb0fced41c8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:41.668949 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-91545044-da32-4269-b378-6bb0fced41c8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:41.907890 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-91545044-da32-4269-b378-6bb0fced41c8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:41.920197 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-91545044-da32-4269-b378-6bb0fced41c8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.269764 Jul 28 18:04:41.937106 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 178/355] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:41 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:42.074763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-57a9cabf-5d94-4a9a-bb99-566001faf676 req-5bf68151-cf2b-4385-8cf3-9627bb3b81a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dd071c-f443-4fbc-a37c-0b8b250968a4", "name": "network-vif-plugged", "status": "completed", "tag": "9f9562ad-51bd-4d8e-b76b-7edbbe736d9f"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:42.107756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-57a9cabf-5d94-4a9a-bb99-566001faf676 req-5bf68151-cf2b-4385-8cf3-9627bb3b81a5 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:42.110411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-57a9cabf-5d94-4a9a-bb99-566001faf676 req-5bf68151-cf2b-4385-8cf3-9627bb3b81a5 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:42.138319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-57a9cabf-5d94-4a9a-bb99-566001faf676 req-5bf68151-cf2b-4385-8cf3-9627bb3b81a5 service nova] Creating event network-vif-plugged:9f9562ad-51bd-4d8e-b76b-7edbbe736d9f for instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 on hv-cinder-83754 Jul 28 18:04:42.159138 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-57a9cabf-5d94-4a9a-bb99-566001faf676 req-5bf68151-cf2b-4385-8cf3-9627bb3b81a5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090147 Jul 28 18:04:42.161739 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 179/356] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:04:42.358024 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-69e29818-7337-40f3-8457-ece9f380ad2f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:42.358763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-69e29818-7337-40f3-8457-ece9f380ad2f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:42.369775 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-69e29818-7337-40f3-8457-ece9f380ad2f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:42.371869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-69e29818-7337-40f3-8457-ece9f380ad2f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:42.379949 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-69e29818-7337-40f3-8457-ece9f380ad2f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:42.379949 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-69e29818-7337-40f3-8457-ece9f380ad2f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:42.649751 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b250a2f7-a2a7-4d13-b275-90e74f100849 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:42.669070 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b250a2f7-a2a7-4d13-b275-90e74f100849 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 1.313203 Jul 28 18:04:42.673848 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 178/357] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:41 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:42.677082 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=6 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:42.682219 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-69e29818-7337-40f3-8457-ece9f380ad2f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:42.685797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:42.692579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:42.709253 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-69e29818-7337-40f3-8457-ece9f380ad2f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1316 microversion: 2.1 time: 0.352875 Jul 28 18:04:42.713227 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 180/358] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:42 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:42.727344 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:42.733922 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:42.734775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:42.736383 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:42.948376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fa383998-69a5-4c9f-a66d-a8483e57d4a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:42.948376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-fa383998-69a5-4c9f-a66d-a8483e57d4a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:42.961160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fa383998-69a5-4c9f-a66d-a8483e57d4a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:42.961635 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fa383998-69a5-4c9f-a66d-a8483e57d4a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:42.962469 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fa383998-69a5-4c9f-a66d-a8483e57d4a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:42.962893 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fa383998-69a5-4c9f-a66d-a8483e57d4a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:43.300729 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-fa383998-69a5-4c9f-a66d-a8483e57d4a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:43.335886 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fa383998-69a5-4c9f-a66d-a8483e57d4a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.397912 Jul 28 18:04:43.348167 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 181/359] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:42 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:43.576111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:43.581644 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:43.589623 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:43.592819 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:43.596343 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-095e75e9-10b2-400e-8ba0-be69adfcbf7d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.920421 Jul 28 18:04:43.597752 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 179/360] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:42 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:43.717434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-93fc8cbd-e8ca-44a2-8859-3838169085fb tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:43.717434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-93fc8cbd-e8ca-44a2-8859-3838169085fb tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:43.719950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=4 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:43.728006 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-93fc8cbd-e8ca-44a2-8859-3838169085fb tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:43.728918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-93fc8cbd-e8ca-44a2-8859-3838169085fb tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:43.729921 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-93fc8cbd-e8ca-44a2-8859-3838169085fb tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:43.730516 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-93fc8cbd-e8ca-44a2-8859-3838169085fb tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:43.747895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c1166a1a-9fa7-4783-b60f-87d7512d0fa5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:43.748892 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c1166a1a-9fa7-4783-b60f-87d7512d0fa5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:43.757927 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c1166a1a-9fa7-4783-b60f-87d7512d0fa5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:43.758504 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c1166a1a-9fa7-4783-b60f-87d7512d0fa5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:43.759646 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c1166a1a-9fa7-4783-b60f-87d7512d0fa5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:43.760187 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c1166a1a-9fa7-4783-b60f-87d7512d0fa5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:43.844672 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c1166a1a-9fa7-4783-b60f-87d7512d0fa5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:43.853913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c1166a1a-9fa7-4783-b60f-87d7512d0fa5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1316 microversion: 2.1 time: 0.117743 Jul 28 18:04:43.854539 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 180/361] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:43 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1316 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:43.910692 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-93fc8cbd-e8ca-44a2-8859-3838169085fb tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:43.919881 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-93fc8cbd-e8ca-44a2-8859-3838169085fb tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.215536 Jul 28 18:04:43.920514 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 182/362] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:43 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:44.372595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c296e1b2-36e4-4185-9542-8ed47e8ad0f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:44.373469 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c296e1b2-36e4-4185-9542-8ed47e8ad0f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:44.386149 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c296e1b2-36e4-4185-9542-8ed47e8ad0f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:44.391471 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c296e1b2-36e4-4185-9542-8ed47e8ad0f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:44.391471 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c296e1b2-36e4-4185-9542-8ed47e8ad0f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:44.391471 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c296e1b2-36e4-4185-9542-8ed47e8ad0f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:44.525395 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=32 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:44.621988 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:44.623089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:44.637570 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:44.642797 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:44.642797 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:44.642797 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:44.694833 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c296e1b2-36e4-4185-9542-8ed47e8ad0f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:44.708195 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c296e1b2-36e4-4185-9542-8ed47e8ad0f5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.339670 Jul 28 18:04:44.723290 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 181/363] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:44 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:44.885144 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bfdf2ff7-8dd3-45ad-8b22-3627c0cb1b92 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:44.885930 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bfdf2ff7-8dd3-45ad-8b22-3627c0cb1b92 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:44.912970 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bfdf2ff7-8dd3-45ad-8b22-3627c0cb1b92 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:44.913434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bfdf2ff7-8dd3-45ad-8b22-3627c0cb1b92 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:44.914239 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bfdf2ff7-8dd3-45ad-8b22-3627c0cb1b92 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:44.914709 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bfdf2ff7-8dd3-45ad-8b22-3627c0cb1b92 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:45.342472 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bfdf2ff7-8dd3-45ad-8b22-3627c0cb1b92 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:45.346131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:45.366058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:45.367391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bfdf2ff7-8dd3-45ad-8b22-3627c0cb1b92 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.492420 Jul 28 18:04:45.382050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:45.383555 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c4f41ed1-d9e5-441c-a14d-ad5ced9babb1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.765301 Jul 28 18:04:45.394793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 183/364] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:44 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:45.395078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 182/365] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:44 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:45.404877 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c26c8b92-f585-4a8b-9414-329242ac2dc1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:45.404877 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c26c8b92-f585-4a8b-9414-329242ac2dc1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:45.415942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c26c8b92-f585-4a8b-9414-329242ac2dc1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:45.416396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c26c8b92-f585-4a8b-9414-329242ac2dc1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:45.417326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c26c8b92-f585-4a8b-9414-329242ac2dc1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:45.418468 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c26c8b92-f585-4a8b-9414-329242ac2dc1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:45.686863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c26c8b92-f585-4a8b-9414-329242ac2dc1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:45.699870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c26c8b92-f585-4a8b-9414-329242ac2dc1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.314728 Jul 28 18:04:45.725632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 184/366] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:45 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:45.731925 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c99b7be9-8207-4146-b6b0-8dd5b42fe983 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:45.732876 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c99b7be9-8207-4146-b6b0-8dd5b42fe983 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:45.752326 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c99b7be9-8207-4146-b6b0-8dd5b42fe983 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:45.752860 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c99b7be9-8207-4146-b6b0-8dd5b42fe983 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:45.753682 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c99b7be9-8207-4146-b6b0-8dd5b42fe983 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:45.759707 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c99b7be9-8207-4146-b6b0-8dd5b42fe983 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:46.221809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c99b7be9-8207-4146-b6b0-8dd5b42fe983 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:46.232582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c99b7be9-8207-4146-b6b0-8dd5b42fe983 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.504938 Jul 28 18:04:46.233154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 183/367] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:45 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:46.390028 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6fc2bd91-26ce-4300-a8f1-ed209c1d5c70 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:46.397428 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6fc2bd91-26ce-4300-a8f1-ed209c1d5c70 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:46.413237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:46.413852 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:46.423154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6fc2bd91-26ce-4300-a8f1-ed209c1d5c70 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:46.423500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6fc2bd91-26ce-4300-a8f1-ed209c1d5c70 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:46.424371 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6fc2bd91-26ce-4300-a8f1-ed209c1d5c70 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:46.424836 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6fc2bd91-26ce-4300-a8f1-ed209c1d5c70 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:46.427919 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:46.428374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:46.429150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:46.429591 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:46.883166 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:46.895645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:46.897808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:46.899463 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-53696f3d-9f21-4ca8-a12e-dec05b444ef7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.491069 Jul 28 18:04:46.900423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 184/368] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:46 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:46.914549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-be18b6f6-72cc-4d59-924c-9879d990b204 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:46.914549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-be18b6f6-72cc-4d59-924c-9879d990b204 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:46.915996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-be18b6f6-72cc-4d59-924c-9879d990b204 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:46.915996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-be18b6f6-72cc-4d59-924c-9879d990b204 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:46.915996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-be18b6f6-72cc-4d59-924c-9879d990b204 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:46.917198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-be18b6f6-72cc-4d59-924c-9879d990b204 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:47.047409 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6fc2bd91-26ce-4300-a8f1-ed209c1d5c70 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:47.064647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6fc2bd91-26ce-4300-a8f1-ed209c1d5c70 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.673432 Jul 28 18:04:47.064647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 185/369] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:46 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:47.222479 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-be18b6f6-72cc-4d59-924c-9879d990b204 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:47.237937 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-87650cc7-5d4c-45da-9628-9e09ad0cad78 req-2d58bb3c-e008-4467-93cc-3103b0c52613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417aa872-dcc4-4460-99fb-d48819d6eead", "tag": "f808f4a9-93f4-4595-be63-aba89386ee2a"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:47.238154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-be18b6f6-72cc-4d59-924c-9879d990b204 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.336510 Jul 28 18:04:47.239076 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 185/370] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:46 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:47.256450 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-87650cc7-5d4c-45da-9628-9e09ad0cad78 req-2d58bb3c-e008-4467-93cc-3103b0c52613 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:47.257016 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-87650cc7-5d4c-45da-9628-9e09ad0cad78 req-2d58bb3c-e008-4467-93cc-3103b0c52613 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:47.259445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-554db742-1970-4547-8e74-b3db0595a4f7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:47.260671 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-554db742-1970-4547-8e74-b3db0595a4f7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:47.297008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-87650cc7-5d4c-45da-9628-9e09ad0cad78 req-2d58bb3c-e008-4467-93cc-3103b0c52613 service nova] Creating event network-changed:f808f4a9-93f4-4595-be63-aba89386ee2a for instance 417aa872-dcc4-4460-99fb-d48819d6eead on hv-cinder-83754 Jul 28 18:04:47.303100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-87650cc7-5d4c-45da-9628-9e09ad0cad78 req-2d58bb3c-e008-4467-93cc-3103b0c52613 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069301 Jul 28 18:04:47.303420 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-554db742-1970-4547-8e74-b3db0595a4f7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:47.304068 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 186/371] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:47.304330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-554db742-1970-4547-8e74-b3db0595a4f7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:47.305155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-554db742-1970-4547-8e74-b3db0595a4f7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:47.305622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-554db742-1970-4547-8e74-b3db0595a4f7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:47.533589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-554db742-1970-4547-8e74-b3db0595a4f7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:47.543036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-554db742-1970-4547-8e74-b3db0595a4f7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.288227 Jul 28 18:04:47.546390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 186/372] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:47 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:47.937005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:47.937706 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:47.957850 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:47.962833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:47.962833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:47.962833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:48.080633 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6d8c4a84-a6cd-4929-8f4c-534c0acbdf8e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:48.081259 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6d8c4a84-a6cd-4929-8f4c-534c0acbdf8e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:48.097033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d8c4a84-a6cd-4929-8f4c-534c0acbdf8e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:48.097509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d8c4a84-a6cd-4929-8f4c-534c0acbdf8e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:48.098311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d8c4a84-a6cd-4929-8f4c-534c0acbdf8e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:48.100012 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d8c4a84-a6cd-4929-8f4c-534c0acbdf8e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:48.386839 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:48.405059 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:48.407457 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:48.408956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-af622ef5-d726-438d-a600-8a9cc2336568 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1740 microversion: 2.20 time: 0.476532 Jul 28 18:04:48.419239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 187/373] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:47 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1740 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:48.459345 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6d8c4a84-a6cd-4929-8f4c-534c0acbdf8e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:48.502196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a246b2ec-32a1-4bec-9453-fb1fb8383736 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:48.503956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a246b2ec-32a1-4bec-9453-fb1fb8383736 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:48.505215 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6d8c4a84-a6cd-4929-8f4c-534c0acbdf8e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.424868 Jul 28 18:04:48.512009 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 187/374] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:48 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:48.518911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a246b2ec-32a1-4bec-9453-fb1fb8383736 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:48.520019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a246b2ec-32a1-4bec-9453-fb1fb8383736 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:48.537558 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a246b2ec-32a1-4bec-9453-fb1fb8383736 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:48.541908 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a246b2ec-32a1-4bec-9453-fb1fb8383736 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:48.567140 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2df93212-514d-4c32-b7c6-9938dde94465 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:48.567784 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2df93212-514d-4c32-b7c6-9938dde94465 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:48.619723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2df93212-514d-4c32-b7c6-9938dde94465 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:48.622898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2df93212-514d-4c32-b7c6-9938dde94465 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:48.625363 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2df93212-514d-4c32-b7c6-9938dde94465 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:48.633120 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2df93212-514d-4c32-b7c6-9938dde94465 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:48.953983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a246b2ec-32a1-4bec-9453-fb1fb8383736 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:48.982596 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a246b2ec-32a1-4bec-9453-fb1fb8383736 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.547708 Jul 28 18:04:48.982596 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 188/375] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:48 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:49.091539 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2df93212-514d-4c32-b7c6-9938dde94465 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:49.105972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2df93212-514d-4c32-b7c6-9938dde94465 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.544975 Jul 28 18:04:49.107017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 188/376] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:48 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:49.438459 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:49.439134 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:49.460166 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:49.460621 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:49.461422 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:49.464822 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:49.528134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fbabde1c-6a0b-4062-927d-d15f6ffbef9b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:49.528777 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fbabde1c-6a0b-4062-927d-d15f6ffbef9b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:49.544958 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fbabde1c-6a0b-4062-927d-d15f6ffbef9b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:49.545417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fbabde1c-6a0b-4062-927d-d15f6ffbef9b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:49.548058 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fbabde1c-6a0b-4062-927d-d15f6ffbef9b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:49.548058 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fbabde1c-6a0b-4062-927d-d15f6ffbef9b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:49.712633 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:49.722458 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:49.725296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:49.726971 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e91952b7-aa53-4887-bb3c-db200043f82b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1722 microversion: 2.20 time: 0.292508 Jul 28 18:04:49.728149 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 189/377] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:49 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:50.006289 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c7f1d5a6-a6cf-4821-8b6f-dcedf162478c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:50.010695 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c7f1d5a6-a6cf-4821-8b6f-dcedf162478c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:50.033512 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7f1d5a6-a6cf-4821-8b6f-dcedf162478c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:50.033512 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7f1d5a6-a6cf-4821-8b6f-dcedf162478c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:50.033512 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7f1d5a6-a6cf-4821-8b6f-dcedf162478c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:50.036433 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7f1d5a6-a6cf-4821-8b6f-dcedf162478c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:50.112645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fbabde1c-6a0b-4062-927d-d15f6ffbef9b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:50.125417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fbabde1c-6a0b-4062-927d-d15f6ffbef9b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.599817 Jul 28 18:04:50.127008 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 189/378] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:49 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:50.134179 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-aead05c8-1089-446d-b851-92f16b4d51a5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:50.135960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-aead05c8-1089-446d-b851-92f16b4d51a5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:50.145114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aead05c8-1089-446d-b851-92f16b4d51a5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:50.148570 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aead05c8-1089-446d-b851-92f16b4d51a5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:50.149375 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aead05c8-1089-446d-b851-92f16b4d51a5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:50.149808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aead05c8-1089-446d-b851-92f16b4d51a5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:50.345211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c7f1d5a6-a6cf-4821-8b6f-dcedf162478c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:50.357480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c7f1d5a6-a6cf-4821-8b6f-dcedf162478c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.355779 Jul 28 18:04:50.372386 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 190/379] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:50 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:50.428956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-aead05c8-1089-446d-b851-92f16b4d51a5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:50.448413 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-aead05c8-1089-446d-b851-92f16b4d51a5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.314631 Jul 28 18:04:50.451025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 190/380] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:50 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:50.759349 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:50.760112 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:50.775693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:50.778770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:50.781672 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:50.782419 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:51.131492 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:51.145519 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:51.151199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:51.152217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2d4a8dee-7a36-4371-83c2-51ca449dd05a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:51.152716 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2d4a8dee-7a36-4371-83c2-51ca449dd05a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:51.158893 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e4290a6b-685d-4153-8d2e-6b1e73889671 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1722 microversion: 2.20 time: 0.405245 Jul 28 18:04:51.165683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2d4a8dee-7a36-4371-83c2-51ca449dd05a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:51.168013 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2d4a8dee-7a36-4371-83c2-51ca449dd05a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:51.168013 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2d4a8dee-7a36-4371-83c2-51ca449dd05a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:51.168013 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2d4a8dee-7a36-4371-83c2-51ca449dd05a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:51.175805 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 191/381] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:50 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:51.430766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-21b9524f-a62f-460a-88e6-8a39ed9cd354 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:51.430766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-21b9524f-a62f-460a-88e6-8a39ed9cd354 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:51.430766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-21b9524f-a62f-460a-88e6-8a39ed9cd354 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:51.430766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-21b9524f-a62f-460a-88e6-8a39ed9cd354 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:51.431529 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-21b9524f-a62f-460a-88e6-8a39ed9cd354 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:51.431529 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-21b9524f-a62f-460a-88e6-8a39ed9cd354 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:51.586683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2d4a8dee-7a36-4371-83c2-51ca449dd05a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:51.597125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2d4a8dee-7a36-4371-83c2-51ca449dd05a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.449275 Jul 28 18:04:51.598270 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 191/382] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:51 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:51.603829 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-84bb62f5-cd77-421e-98de-4c0f815a43b9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:51.604727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-84bb62f5-cd77-421e-98de-4c0f815a43b9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:51.612723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-84bb62f5-cd77-421e-98de-4c0f815a43b9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:51.613182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-84bb62f5-cd77-421e-98de-4c0f815a43b9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:51.615677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-84bb62f5-cd77-421e-98de-4c0f815a43b9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:51.617404 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-84bb62f5-cd77-421e-98de-4c0f815a43b9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:51.807649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-21b9524f-a62f-460a-88e6-8a39ed9cd354 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:51.821786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-84bb62f5-cd77-421e-98de-4c0f815a43b9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:51.828635 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-21b9524f-a62f-460a-88e6-8a39ed9cd354 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.449639 Jul 28 18:04:51.831291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-84bb62f5-cd77-421e-98de-4c0f815a43b9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.231238 Jul 28 18:04:51.831867 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 192/383] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:51 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:51.842932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 192/384] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:51 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:04:52.187662 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:52.189068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:52.196257 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:52.197112 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:52.198108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:52.198763 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:52.352308 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:52.361856 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:52.363952 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:52.367234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8eaf7be3-466e-46d4-bd30-8b448d82dff6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1722 microversion: 2.20 time: 0.184161 Jul 28 18:04:52.368455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 193/385] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:52 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:52.624388 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-24337c95-4d9d-41b3-a96b-c3b97b77e441 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:52.626428 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-24337c95-4d9d-41b3-a96b-c3b97b77e441 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:52.633680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-24337c95-4d9d-41b3-a96b-c3b97b77e441 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:52.635261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-24337c95-4d9d-41b3-a96b-c3b97b77e441 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:52.635834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-24337c95-4d9d-41b3-a96b-c3b97b77e441 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:52.636483 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-24337c95-4d9d-41b3-a96b-c3b97b77e441 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:52.855211 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3fd0f751-ac23-4d97-9180-03439403db32 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:52.856029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3fd0f751-ac23-4d97-9180-03439403db32 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:52.865879 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3fd0f751-ac23-4d97-9180-03439403db32 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:52.866801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3fd0f751-ac23-4d97-9180-03439403db32 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:52.868200 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3fd0f751-ac23-4d97-9180-03439403db32 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:52.868869 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3fd0f751-ac23-4d97-9180-03439403db32 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:52.933079 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-24337c95-4d9d-41b3-a96b-c3b97b77e441 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:52.940166 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-24337c95-4d9d-41b3-a96b-c3b97b77e441 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.319729 Jul 28 18:04:52.940812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 193/386] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:52 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:52.947296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d0f536c2-7bf2-41bb-96f4-b2291d86519c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:52.948487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d0f536c2-7bf2-41bb-96f4-b2291d86519c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:52.955358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d0f536c2-7bf2-41bb-96f4-b2291d86519c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:52.957634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d0f536c2-7bf2-41bb-96f4-b2291d86519c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:52.957634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d0f536c2-7bf2-41bb-96f4-b2291d86519c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:52.957634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d0f536c2-7bf2-41bb-96f4-b2291d86519c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:53.105491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3fd0f751-ac23-4d97-9180-03439403db32 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:53.117775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3fd0f751-ac23-4d97-9180-03439403db32 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.268069 Jul 28 18:04:53.124695 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 194/387] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:52 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:53.392037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:53.393445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:53.401614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:53.402073 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:53.403130 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:53.403563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:53.470561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d0f536c2-7bf2-41bb-96f4-b2291d86519c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:53.479442 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d0f536c2-7bf2-41bb-96f4-b2291d86519c tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.537400 Jul 28 18:04:53.480079 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 194/388] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:52 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:53.601231 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:53.610194 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:53.611901 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:53.613175 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d5208c3d-c7ad-4250-855c-5f8209fc0e6e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1722 microversion: 2.20 time: 0.225972 Jul 28 18:04:53.613812 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 195/389] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:53 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:04:53.964574 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-58b9e0eb-37ca-4c19-8e75-cbfb8b146d57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:53.965193 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-58b9e0eb-37ca-4c19-8e75-cbfb8b146d57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:53.971430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-58b9e0eb-37ca-4c19-8e75-cbfb8b146d57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:53.971884 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-58b9e0eb-37ca-4c19-8e75-cbfb8b146d57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:53.972683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-58b9e0eb-37ca-4c19-8e75-cbfb8b146d57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:53.973116 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-58b9e0eb-37ca-4c19-8e75-cbfb8b146d57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:53.977833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:54.149476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-185a70c8-bf5a-43b4-8428-1d5efc8a9c0a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:54.150402 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-185a70c8-bf5a-43b4-8428-1d5efc8a9c0a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:54.159998 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-185a70c8-bf5a-43b4-8428-1d5efc8a9c0a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:54.161365 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-185a70c8-bf5a-43b4-8428-1d5efc8a9c0a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:54.162595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-185a70c8-bf5a-43b4-8428-1d5efc8a9c0a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:54.163190 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-185a70c8-bf5a-43b4-8428-1d5efc8a9c0a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:54.186616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:54.272532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-58b9e0eb-37ca-4c19-8e75-cbfb8b146d57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:54.280877 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-58b9e0eb-37ca-4c19-8e75-cbfb8b146d57 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.320024 Jul 28 18:04:54.282053 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 195/390] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:53 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:54.507587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5565646d-df72-42cc-ad2d-346b26a45394 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:54.511480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5565646d-df72-42cc-ad2d-346b26a45394 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:54.531995 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5565646d-df72-42cc-ad2d-346b26a45394 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:54.532630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5565646d-df72-42cc-ad2d-346b26a45394 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:54.533579 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5565646d-df72-42cc-ad2d-346b26a45394 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:54.534117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5565646d-df72-42cc-ad2d-346b26a45394 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:55.015235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-185a70c8-bf5a-43b4-8428-1d5efc8a9c0a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:55.027147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-185a70c8-bf5a-43b4-8428-1d5efc8a9c0a tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1371 microversion: 2.1 time: 0.881686 Jul 28 18:04:55.029435 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 196/391] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:54 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1371 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:55.051311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:55.051311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:55.067747 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:55.068652 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:55.069660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:55.070254 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:55.223526 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5565646d-df72-42cc-ad2d-346b26a45394 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:55.248089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5565646d-df72-42cc-ad2d-346b26a45394 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.737720 Jul 28 18:04:55.267252 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 196/392] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:54 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:55.323230 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e0f7d2e0-670e-4889-8b71-901d80f1f88c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:55.324446 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e0f7d2e0-670e-4889-8b71-901d80f1f88c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:55.330684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e0f7d2e0-670e-4889-8b71-901d80f1f88c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:55.336008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e0f7d2e0-670e-4889-8b71-901d80f1f88c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:55.337119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e0f7d2e0-670e-4889-8b71-901d80f1f88c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:55.364312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e0f7d2e0-670e-4889-8b71-901d80f1f88c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:55.476553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:55.498239 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:55.508237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:55.510111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f206d571-faf3-447a-8f2d-a10475e6b5ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1722 microversion: 2.20 time: 0.479379 Jul 28 18:04:55.526929 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 197/393] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:55 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1722 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:55.831135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e0f7d2e0-670e-4889-8b71-901d80f1f88c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:55.831135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e0f7d2e0-670e-4889-8b71-901d80f1f88c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.511499 Jul 28 18:04:55.839395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 197/394] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:55 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:56.058233 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-638fa4ab-5a30-4fe4-8ae0-9fa82c4d50a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:56.059559 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-638fa4ab-5a30-4fe4-8ae0-9fa82c4d50a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:56.066285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-638fa4ab-5a30-4fe4-8ae0-9fa82c4d50a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:56.066717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-638fa4ab-5a30-4fe4-8ae0-9fa82c4d50a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:56.068065 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-638fa4ab-5a30-4fe4-8ae0-9fa82c4d50a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:56.068503 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-638fa4ab-5a30-4fe4-8ae0-9fa82c4d50a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:56.240581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-638fa4ab-5a30-4fe4-8ae0-9fa82c4d50a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:56.254144 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-638fa4ab-5a30-4fe4-8ae0-9fa82c4d50a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1565 microversion: 2.1 time: 0.204787 Jul 28 18:04:56.254981 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 198/395] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:56 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1565 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:56.277978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-86c410b6-6d72-4dcf-83c4-0f6fc0dea1b0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:56.278668 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-86c410b6-6d72-4dcf-83c4-0f6fc0dea1b0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:56.281136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-739bf003-d012-42c3-bf29-54dda6ada002 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:56.281661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-739bf003-d012-42c3-bf29-54dda6ada002 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:56.285254 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86c410b6-6d72-4dcf-83c4-0f6fc0dea1b0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:56.285904 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86c410b6-6d72-4dcf-83c4-0f6fc0dea1b0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:56.291900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86c410b6-6d72-4dcf-83c4-0f6fc0dea1b0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:56.291900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86c410b6-6d72-4dcf-83c4-0f6fc0dea1b0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:56.292133 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-739bf003-d012-42c3-bf29-54dda6ada002 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:56.292133 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-739bf003-d012-42c3-bf29-54dda6ada002 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:56.292133 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-739bf003-d012-42c3-bf29-54dda6ada002 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:56.292430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-739bf003-d012-42c3-bf29-54dda6ada002 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:56.441636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-739bf003-d012-42c3-bf29-54dda6ada002 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164600 Jul 28 18:04:56.444586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 199/396] 10.222.0.85 () {58 vars in 1275 bytes} [Thu Jul 28 18:04:56 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:04:56.554872 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:56.556717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:56.559582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:04:56.571386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:56.571941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:56.575748 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:56.576236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:56.906225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-86c410b6-6d72-4dcf-83c4-0f6fc0dea1b0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:56.923276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-86c410b6-6d72-4dcf-83c4-0f6fc0dea1b0 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.650423 Jul 28 18:04:56.927879 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 198/397] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:56 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:56.944964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-f77a15b1-c2dc-4f5f-9692-d051a9859af7 req-df6e8bb3-eb16-4e56-afa0-1d74dca2d99e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f64c566-cf5d-4240-95e2-c5746a5bba89", "name": "network-vif-unplugged", "status": "completed", "tag": "8980c8f3-7810-4b7b-b88d-1b866e291a34"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:57.001924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-f77a15b1-c2dc-4f5f-9692-d051a9859af7 req-df6e8bb3-eb16-4e56-afa0-1d74dca2d99e service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:57.005095 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-f77a15b1-c2dc-4f5f-9692-d051a9859af7 req-df6e8bb3-eb16-4e56-afa0-1d74dca2d99e service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:57.047635 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-f77a15b1-c2dc-4f5f-9692-d051a9859af7 req-df6e8bb3-eb16-4e56-afa0-1d74dca2d99e service nova] Creating event network-vif-unplugged:8980c8f3-7810-4b7b-b88d-1b866e291a34 for instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 on hv-cinder-83754 Jul 28 18:04:57.072795 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-f77a15b1-c2dc-4f5f-9692-d051a9859af7 req-df6e8bb3-eb16-4e56-afa0-1d74dca2d99e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142550 Jul 28 18:04:57.078889 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 199/398] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:57.100396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-12e39e05-cf14-4b5a-8bf9-8a382a76f182 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:57.100396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-12e39e05-cf14-4b5a-8bf9-8a382a76f182 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:57.105070 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12e39e05-cf14-4b5a-8bf9-8a382a76f182 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:57.105517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12e39e05-cf14-4b5a-8bf9-8a382a76f182 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:57.106305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12e39e05-cf14-4b5a-8bf9-8a382a76f182 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:57.106761 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12e39e05-cf14-4b5a-8bf9-8a382a76f182 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:57.380747 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:57.396458 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:57.398766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:57.399910 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a9f80d42-ee02-4887-8cbb-0a1b39390cc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1722 microversion: 2.20 time: 0.850644 Jul 28 18:04:57.415458 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 200/399] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:56 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1722 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:57.640794 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-12e39e05-cf14-4b5a-8bf9-8a382a76f182 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:57.656780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-12e39e05-cf14-4b5a-8bf9-8a382a76f182 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.576306 Jul 28 18:04:57.657638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 200/400] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:57 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:57.954495 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c806b807-6b08-445c-a74d-357976cbd730 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:57.956071 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c806b807-6b08-445c-a74d-357976cbd730 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:57.964117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c806b807-6b08-445c-a74d-357976cbd730 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:57.964906 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c806b807-6b08-445c-a74d-357976cbd730 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:57.965868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c806b807-6b08-445c-a74d-357976cbd730 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:57.966491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c806b807-6b08-445c-a74d-357976cbd730 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:58.426081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:58.427507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:58.444688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:58.447931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:58.451611 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:58.452629 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:58.587804 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c806b807-6b08-445c-a74d-357976cbd730 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:58.602717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c806b807-6b08-445c-a74d-357976cbd730 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.649050 Jul 28 18:04:58.602717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 201/401] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:57 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:58.688000 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-390e118c-f644-467e-a3e3-c0cd3c271a60 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:58.691629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-390e118c-f644-467e-a3e3-c0cd3c271a60 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:58.705589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-390e118c-f644-467e-a3e3-c0cd3c271a60 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:58.708279 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-390e118c-f644-467e-a3e3-c0cd3c271a60 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:58.709287 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-390e118c-f644-467e-a3e3-c0cd3c271a60 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:58.711609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-390e118c-f644-467e-a3e3-c0cd3c271a60 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:58.864198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:58.876355 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:58.878337 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:58.879581 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a20e8f57-7b09-49c3-a047-cd6631765c44 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1722 microversion: 2.20 time: 0.457883 Jul 28 18:04:58.882841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 201/402] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:58 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1722 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:04:59.532725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-390e118c-f644-467e-a3e3-c0cd3c271a60 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:59.548552 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-390e118c-f644-467e-a3e3-c0cd3c271a60 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.864244 Jul 28 18:04:59.550908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 202/403] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:58 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:04:59.621399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-47a227f0-b6c7-4dd5-9dd4-150a2c0730c4 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:59.622024 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-47a227f0-b6c7-4dd5-9dd4-150a2c0730c4 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:59.628170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-47a227f0-b6c7-4dd5-9dd4-150a2c0730c4 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:59.629484 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-47a227f0-b6c7-4dd5-9dd4-150a2c0730c4 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:59.629484 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-47a227f0-b6c7-4dd5-9dd4-150a2c0730c4 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:59.630871 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-47a227f0-b6c7-4dd5-9dd4-150a2c0730c4 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:59.847187 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-6f00040b-2c18-43ac-901c-bb7941602994 req-2658e1a0-ca07-49e9-847d-a73c73c8c848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dd071c-f443-4fbc-a37c-0b8b250968a4", "tag": "9f9562ad-51bd-4d8e-b76b-7edbbe736d9f"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:04:59.860712 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-6f00040b-2c18-43ac-901c-bb7941602994 req-2658e1a0-ca07-49e9-847d-a73c73c8c848 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:59.861067 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-6f00040b-2c18-43ac-901c-bb7941602994 req-2658e1a0-ca07-49e9-847d-a73c73c8c848 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:59.892652 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-6f00040b-2c18-43ac-901c-bb7941602994 req-2658e1a0-ca07-49e9-847d-a73c73c8c848 service nova] Creating event network-changed:9f9562ad-51bd-4d8e-b76b-7edbbe736d9f for instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 on hv-cinder-83754 Jul 28 18:04:59.899482 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-6f00040b-2c18-43ac-901c-bb7941602994 req-2658e1a0-ca07-49e9-847d-a73c73c8c848 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055842 Jul 28 18:04:59.900262 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 203/404] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:04:59.917457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:04:59.918699 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:04:59.927400 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:59.930931 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:59.932824 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:04:59.940008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-47a227f0-b6c7-4dd5-9dd4-150a2c0730c4 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:04:59.940902 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:04:59.955552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-47a227f0-b6c7-4dd5-9dd4-150a2c0730c4 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.338577 Jul 28 18:04:59.959440 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 202/405] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:04:59 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:00.381994 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:00.406423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:00.420913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:00.420913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bdc009cd-3c0b-454e-970c-e31c37f6b4fc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1722 microversion: 2.20 time: 0.506254 Jul 28 18:05:00.420913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 204/406] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:04:59 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1722 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:00.573257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1f3bbaf1-8052-4340-aeb7-2d71e7f34c94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:00.575040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1f3bbaf1-8052-4340-aeb7-2d71e7f34c94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:00.603230 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f3bbaf1-8052-4340-aeb7-2d71e7f34c94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:00.605116 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f3bbaf1-8052-4340-aeb7-2d71e7f34c94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:00.611853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f3bbaf1-8052-4340-aeb7-2d71e7f34c94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:00.615301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1f3bbaf1-8052-4340-aeb7-2d71e7f34c94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:00.990225 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-529ccb51-6fd3-4c65-a3ea-7d85bcebe391 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:00.990225 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-529ccb51-6fd3-4c65-a3ea-7d85bcebe391 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:01.013824 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-529ccb51-6fd3-4c65-a3ea-7d85bcebe391 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:01.022073 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-529ccb51-6fd3-4c65-a3ea-7d85bcebe391 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:01.024557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-529ccb51-6fd3-4c65-a3ea-7d85bcebe391 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:01.027091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-529ccb51-6fd3-4c65-a3ea-7d85bcebe391 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:01.888987 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1f3bbaf1-8052-4340-aeb7-2d71e7f34c94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:01.901169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1f3bbaf1-8052-4340-aeb7-2d71e7f34c94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 1.332554 Jul 28 18:05:01.925241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 203/407] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:00 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:05:01.925620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-529ccb51-6fd3-4c65-a3ea-7d85bcebe391 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:01.941347 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-e2bf3878-1a84-47c3-bcc4-9fd2bfd44492 req-aa0f0dec-7012-4bb9-92af-42fb0d5d2b82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae762fd-1a0b-48e7-891f-8555a4624c57", "name": "network-vif-plugged", "status": "completed", "tag": "de56644a-cd04-4c51-a8f8-1f45ca90a5a8"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:01.943243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-529ccb51-6fd3-4c65-a3ea-7d85bcebe391 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.958310 Jul 28 18:05:01.943243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 205/408] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:00 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:05:01.976516 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:01.977199 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:02.008359 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:02.012066 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:02.017813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:02.020407 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:02.038639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-e2bf3878-1a84-47c3-bcc4-9fd2bfd44492 req-aa0f0dec-7012-4bb9-92af-42fb0d5d2b82 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:02.040553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-e2bf3878-1a84-47c3-bcc4-9fd2bfd44492 req-aa0f0dec-7012-4bb9-92af-42fb0d5d2b82 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:02.102964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-e2bf3878-1a84-47c3-bcc4-9fd2bfd44492 req-aa0f0dec-7012-4bb9-92af-42fb0d5d2b82 service nova] Creating event network-vif-plugged:de56644a-cd04-4c51-a8f8-1f45ca90a5a8 for instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 on hv-cinder-83754 Jul 28 18:05:02.112164 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-e2bf3878-1a84-47c3-bcc4-9fd2bfd44492 req-aa0f0dec-7012-4bb9-92af-42fb0d5d2b82 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198306 Jul 28 18:05:02.113065 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 204/409] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:02.583712 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:02.611324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:02.615702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:02.625963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ede90020-fda1-4ae7-bfce-7162e63465ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1725 microversion: 2.20 time: 0.669769 Jul 28 18:05:02.626870 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 206/410] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:01 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1725 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:02.655887 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-34deb9d0-6775-482a-af43-fb83cc4c39c3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a7190da-a0b1-4bac-98b3-f4290437c17c"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:02.660550 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-34deb9d0-6775-482a-af43-fb83cc4c39c3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:02.691319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34deb9d0-6775-482a-af43-fb83cc4c39c3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:02.692891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34deb9d0-6775-482a-af43-fb83cc4c39c3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:02.693895 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34deb9d0-6775-482a-af43-fb83cc4c39c3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:02.694686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34deb9d0-6775-482a-af43-fb83cc4c39c3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:03.089440 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f32e5061-46ff-47d9-b3c8-0336e995a6f8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Action: 'create', calling method: .version_select at 0x7fdae0418700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1518406974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPruuk04RGai13/fmdOANhipNtjAc2ij/tpa46DnKBvlqlE87ETQJpia0sykcc8BpUVSNljUOwP4q5MX1xLsXssqYl1z9Le9bAw2kbMiAr9v9ghDNFtUzU/VDLTffbc6iA=="}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:03.153857 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-f32e5061-46ff-47d9-b3c8-0336e995a6f8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Getting quotas for project a1b1e6abd55a4b17b4a452a80a6bbdbc. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:05:03.173344 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-f32e5061-46ff-47d9-b3c8-0336e995a6f8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Getting quotas for user 73edfd05da254457b6ad9c9c9f662e4c and project a1b1e6abd55a4b17b4a452a80a6bbdbc. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:05:03.303723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f32e5061-46ff-47d9-b3c8-0336e995a6f8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.631752 Jul 28 18:05:03.304752 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 207/411] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:05:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:03.311523 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ebd41f08-c561-4b9a-8a85-38365e6f37bd tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:03.315932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ebd41f08-c561-4b9a-8a85-38365e6f37bd tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:03.331296 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ebd41f08-c561-4b9a-8a85-38365e6f37bd tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:03.332052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ebd41f08-c561-4b9a-8a85-38365e6f37bd tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:03.335975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ebd41f08-c561-4b9a-8a85-38365e6f37bd tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:03.336701 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ebd41f08-c561-4b9a-8a85-38365e6f37bd tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:03.959670 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ebd41f08-c561-4b9a-8a85-38365e6f37bd tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:03.965986 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ebd41f08-c561-4b9a-8a85-38365e6f37bd tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.659811 Jul 28 18:05:03.966599 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 208/412] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:03 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:03.986005 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-34779c0d-6c5a-465c-b627-cddff542a574 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:03.986650 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-34779c0d-6c5a-465c-b627-cddff542a574 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:04.018507 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-34779c0d-6c5a-465c-b627-cddff542a574 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:04.018956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-34779c0d-6c5a-465c-b627-cddff542a574 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:04.032616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-34779c0d-6c5a-465c-b627-cddff542a574 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:04.037078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-34779c0d-6c5a-465c-b627-cddff542a574 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:04.250834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-34779c0d-6c5a-465c-b627-cddff542a574 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:04.274819 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-34779c0d-6c5a-465c-b627-cddff542a574 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.280941 Jul 28 18:05:04.274819 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 209/413] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:03 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:04.353110 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-34deb9d0-6775-482a-af43-fb83cc4c39c3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.701839 Jul 28 18:05:04.354084 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 205/414] 10.222.0.85 () {62 vars in 1364 bytes} [Thu Jul 28 18:05:02 2022] POST /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments => generated 188 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:05:04.608313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-db48880f-cd37-492b-bb10-43a4b4032dc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:04.608925 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-db48880f-cd37-492b-bb10-43a4b4032dc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:04.617381 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-db48880f-cd37-492b-bb10-43a4b4032dc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:04.617836 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-db48880f-cd37-492b-bb10-43a4b4032dc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:04.618655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-db48880f-cd37-492b-bb10-43a4b4032dc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:04.619115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-db48880f-cd37-492b-bb10-43a4b4032dc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:04.694629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-db48880f-cd37-492b-bb10-43a4b4032dc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130400) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 18:05:04.996418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1a76b8b2-b5a8-4048-b50d-d476da5a2f5f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:04.997179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1a76b8b2-b5a8-4048-b50d-d476da5a2f5f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:05.004950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1a76b8b2-b5a8-4048-b50d-d476da5a2f5f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:05.006595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1a76b8b2-b5a8-4048-b50d-d476da5a2f5f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:05.013069 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1a76b8b2-b5a8-4048-b50d-d476da5a2f5f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:05.013970 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1a76b8b2-b5a8-4048-b50d-d476da5a2f5f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:05.228873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1a76b8b2-b5a8-4048-b50d-d476da5a2f5f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:05.236832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1a76b8b2-b5a8-4048-b50d-d476da5a2f5f tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.253011 Jul 28 18:05:05.237395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 206/415] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:04 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:05.300829 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a5144883-09e0-465b-925a-878f656f0003 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:05.303125 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a5144883-09e0-465b-925a-878f656f0003 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:05.311202 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a5144883-09e0-465b-925a-878f656f0003 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:05.312339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a5144883-09e0-465b-925a-878f656f0003 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:05.313415 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a5144883-09e0-465b-925a-878f656f0003 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:05.314061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a5144883-09e0-465b-925a-878f656f0003 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:05.469851 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a5144883-09e0-465b-925a-878f656f0003 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:05.478435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a5144883-09e0-465b-925a-878f656f0003 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.183707 Jul 28 18:05:05.479010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 207/416] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:05 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:06.092629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-db48880f-cd37-492b-bb10-43a4b4032dc7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/action" status: 202 len: 0 microversion: 2.20 time: 1.496614 Jul 28 18:05:06.101420 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 210/417] 10.222.0.85 () {62 vars in 1319 bytes} [Thu Jul 28 18:05:04 2022] POST /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/action => generated 0 bytes in 1500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:05:06.112169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:06.118177 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:06.141582 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:06.142586 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:06.150408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:06.150408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:06.269227 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-454407b9-e1da-4e96-9f1a-5aeb15d2e88b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:06.269974 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-454407b9-e1da-4e96-9f1a-5aeb15d2e88b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:06.280408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-454407b9-e1da-4e96-9f1a-5aeb15d2e88b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:06.288771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-454407b9-e1da-4e96-9f1a-5aeb15d2e88b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:06.288771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-454407b9-e1da-4e96-9f1a-5aeb15d2e88b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:06.288771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-454407b9-e1da-4e96-9f1a-5aeb15d2e88b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:06.503508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:06.531394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:06.538692 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:06.539938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-64218ef5-eeb2-49b6-95f4-2cff7c6372db tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1751 microversion: 2.20 time: 0.436726 Jul 28 18:05:06.554443 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 208/418] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:06 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1751 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:06.562429 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7be57340-316d-4863-ab75-112b1fe42125 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:06.562429 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7be57340-316d-4863-ab75-112b1fe42125 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:06.570088 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7be57340-316d-4863-ab75-112b1fe42125 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:06.570752 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-454407b9-e1da-4e96-9f1a-5aeb15d2e88b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:06.579795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-454407b9-e1da-4e96-9f1a-5aeb15d2e88b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.314976 Jul 28 18:05:06.580305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7be57340-316d-4863-ab75-112b1fe42125 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:06.581262 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7be57340-316d-4863-ab75-112b1fe42125 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:06.581708 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7be57340-316d-4863-ab75-112b1fe42125 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:06.599309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 211/419] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:06 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:06.816808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7be57340-316d-4863-ab75-112b1fe42125 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:06.831334 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7be57340-316d-4863-ab75-112b1fe42125 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1313 microversion: 2.1 time: 0.286045 Jul 28 18:05:06.852100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 209/420] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:06 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:07.571329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:07.572565 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:07.580513 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:07.581162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:07.582250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:07.583072 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:07.606468 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-67cba595-2f3b-40fb-b185-b9fdeef17972 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:07.607199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-67cba595-2f3b-40fb-b185-b9fdeef17972 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:07.637012 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-67cba595-2f3b-40fb-b185-b9fdeef17972 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:07.637382 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-67cba595-2f3b-40fb-b185-b9fdeef17972 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:07.638157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-67cba595-2f3b-40fb-b185-b9fdeef17972 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:07.638608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-67cba595-2f3b-40fb-b185-b9fdeef17972 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:07.667287 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:07.834143 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:07.866849 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:07.868425 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:07.869641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2ac56abc-ed07-4ba4-a97b-8278f6c514e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1751 microversion: 2.20 time: 0.303395 Jul 28 18:05:07.870190 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 212/421] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:07 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1751 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:07.890567 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-aa4a6127-8d20-4dee-9b04-b9af66664f5e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:07.891196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-aa4a6127-8d20-4dee-9b04-b9af66664f5e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:07.906249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aa4a6127-8d20-4dee-9b04-b9af66664f5e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:07.908294 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aa4a6127-8d20-4dee-9b04-b9af66664f5e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:07.912089 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aa4a6127-8d20-4dee-9b04-b9af66664f5e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:07.912567 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aa4a6127-8d20-4dee-9b04-b9af66664f5e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:07.981496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-67cba595-2f3b-40fb-b185-b9fdeef17972 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:08.010422 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-67cba595-2f3b-40fb-b185-b9fdeef17972 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.406734 Jul 28 18:05:08.011502 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 210/422] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:07 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:08.119362 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-aa4a6127-8d20-4dee-9b04-b9af66664f5e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:08.131553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-aa4a6127-8d20-4dee-9b04-b9af66664f5e tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1498 microversion: 2.1 time: 0.256172 Jul 28 18:05:08.140254 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 213/423] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:07 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1498 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:08.900266 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:08.901713 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:08.914167 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:08.914750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:08.915817 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:08.916566 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:09.047022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ea720ede-2a8b-4ec2-8348-85652d48e04b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:09.047022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ea720ede-2a8b-4ec2-8348-85652d48e04b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:09.078763 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea720ede-2a8b-4ec2-8348-85652d48e04b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:09.080122 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea720ede-2a8b-4ec2-8348-85652d48e04b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:09.100883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea720ede-2a8b-4ec2-8348-85652d48e04b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:09.101760 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea720ede-2a8b-4ec2-8348-85652d48e04b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:09.113035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:09.115810 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:09.148764 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:09.150812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:09.152025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7312be0c-e080-4792-a939-c05ccb7a5c3d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1751 microversion: 2.20 time: 0.257972 Jul 28 18:05:09.152596 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 211/424] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:08 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1751 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:09.341416 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ea720ede-2a8b-4ec2-8348-85652d48e04b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:09.349116 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ea720ede-2a8b-4ec2-8348-85652d48e04b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.315917 Jul 28 18:05:09.349668 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 214/425] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:09 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:09.718939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ea58f014-6ca3-40b9-a682-2e698c081ec1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:09.721015 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ea58f014-6ca3-40b9-a682-2e698c081ec1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:09.721375 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=88 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:09.726246 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea58f014-6ca3-40b9-a682-2e698c081ec1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:09.726987 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea58f014-6ca3-40b9-a682-2e698c081ec1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:09.727760 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea58f014-6ca3-40b9-a682-2e698c081ec1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:09.728199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea58f014-6ca3-40b9-a682-2e698c081ec1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:09.756058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ea58f014-6ca3-40b9-a682-2e698c081ec1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:05:10.009042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ea58f014-6ca3-40b9-a682-2e698c081ec1 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "DELETE /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 204 len: 0 microversion: 2.1 time: 0.293540 Jul 28 18:05:10.009679 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 212/426] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:05:09 2022] DELETE /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:05:10.019373 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-761c7fe6-f082-4ebc-8d5c-9da3ec89ee7a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:10.020007 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-761c7fe6-f082-4ebc-8d5c-9da3ec89ee7a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:10.026484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-761c7fe6-f082-4ebc-8d5c-9da3ec89ee7a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:10.027127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-761c7fe6-f082-4ebc-8d5c-9da3ec89ee7a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:10.031814 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-761c7fe6-f082-4ebc-8d5c-9da3ec89ee7a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:10.031814 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-761c7fe6-f082-4ebc-8d5c-9da3ec89ee7a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:10.165524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-761c7fe6-f082-4ebc-8d5c-9da3ec89ee7a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:10.173994 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-761c7fe6-f082-4ebc-8d5c-9da3ec89ee7a tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1504 microversion: 2.1 time: 0.160009 Jul 28 18:05:10.174599 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 215/427] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:10 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:10.185069 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:10.185830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:10.192490 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:10.192945 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:10.193740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:10.194175 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:10.335061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:10.343660 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:10.345180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:10.346541 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-44620e9d-e6a9-44bb-b58c-0427c2e7893d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1753 microversion: 2.20 time: 0.171679 Jul 28 18:05:10.349259 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 213/428] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:10 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:10.373282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-345833e9-8006-453c-b1e3-e5ca02556b04 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:10.373898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-345833e9-8006-453c-b1e3-e5ca02556b04 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:10.381578 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-345833e9-8006-453c-b1e3-e5ca02556b04 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:10.382028 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-345833e9-8006-453c-b1e3-e5ca02556b04 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:10.382839 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-345833e9-8006-453c-b1e3-e5ca02556b04 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:10.383279 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-345833e9-8006-453c-b1e3-e5ca02556b04 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:10.528019 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-345833e9-8006-453c-b1e3-e5ca02556b04 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:10.535807 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-345833e9-8006-453c-b1e3-e5ca02556b04 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.166279 Jul 28 18:05:10.536377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 216/429] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:10 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:11.196895 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-34c15e43-d9b8-475a-bc2a-312d0d1db5fc tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:11.197506 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-34c15e43-d9b8-475a-bc2a-312d0d1db5fc tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:11.203534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34c15e43-d9b8-475a-bc2a-312d0d1db5fc tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:11.203976 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34c15e43-d9b8-475a-bc2a-312d0d1db5fc tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:11.204808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34c15e43-d9b8-475a-bc2a-312d0d1db5fc tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:11.205423 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34c15e43-d9b8-475a-bc2a-312d0d1db5fc tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:11.343803 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-34c15e43-d9b8-475a-bc2a-312d0d1db5fc tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:11.352060 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-34c15e43-d9b8-475a-bc2a-312d0d1db5fc tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1504 microversion: 2.1 time: 0.159250 Jul 28 18:05:11.352615 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 214/430] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:11 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:11.372850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:11.373395 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:11.380352 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:11.380789 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:11.381550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:11.381985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:11.517705 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:11.526238 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:11.527782 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:11.528951 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8913dca0-57ea-4652-8533-6b8dfe2f9c29 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1753 microversion: 2.20 time: 0.160133 Jul 28 18:05:11.529541 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 217/431] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:11 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:11.557713 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3ef2593d-0af6-4178-a51e-13e7cc9091ff tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:11.558325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3ef2593d-0af6-4178-a51e-13e7cc9091ff tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:11.564320 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3ef2593d-0af6-4178-a51e-13e7cc9091ff tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:11.564770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3ef2593d-0af6-4178-a51e-13e7cc9091ff tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:11.565531 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3ef2593d-0af6-4178-a51e-13e7cc9091ff tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:11.565968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3ef2593d-0af6-4178-a51e-13e7cc9091ff tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:11.707937 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-3ef2593d-0af6-4178-a51e-13e7cc9091ff tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:11.715943 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3ef2593d-0af6-4178-a51e-13e7cc9091ff tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.161939 Jul 28 18:05:11.716474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 215/432] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:11 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:12.375508 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7982028f-b654-4e13-95fd-286b6173f618 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:12.377332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7982028f-b654-4e13-95fd-286b6173f618 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:12.398750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7982028f-b654-4e13-95fd-286b6173f618 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:12.398750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7982028f-b654-4e13-95fd-286b6173f618 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:12.398750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7982028f-b654-4e13-95fd-286b6173f618 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:12.398750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7982028f-b654-4e13-95fd-286b6173f618 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:12.479074 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7982028f-b654-4e13-95fd-286b6173f618 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:12.488229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7982028f-b654-4e13-95fd-286b6173f618 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1462 microversion: 2.1 time: 0.117656 Jul 28 18:05:12.491705 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 218/433] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:12 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1462 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:12.507222 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-516fa578-21b2-4b02-b1ee-d7560d4d5d9f req-92949cba-2e77-4c33-a5d1-54ce55d77529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae762fd-1a0b-48e7-891f-8555a4624c57", "name": "network-vif-deleted", "tag": "de56644a-cd04-4c51-a8f8-1f45ca90a5a8"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:12.522092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-516fa578-21b2-4b02-b1ee-d7560d4d5d9f req-92949cba-2e77-4c33-a5d1-54ce55d77529 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:12.522775 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-516fa578-21b2-4b02-b1ee-d7560d4d5d9f req-92949cba-2e77-4c33-a5d1-54ce55d77529 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:12.540621 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-516fa578-21b2-4b02-b1ee-d7560d4d5d9f req-92949cba-2e77-4c33-a5d1-54ce55d77529 service nova] Creating event network-vif-deleted:de56644a-cd04-4c51-a8f8-1f45ca90a5a8 for instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 on hv-cinder-83754 Jul 28 18:05:12.548580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-516fa578-21b2-4b02-b1ee-d7560d4d5d9f req-92949cba-2e77-4c33-a5d1-54ce55d77529 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050098 Jul 28 18:05:12.549852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 216/434] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:12.554859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:12.555606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:12.562299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:12.562870 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:12.563789 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:12.564305 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:12.614441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-c36e9b9f-bb8e-4a23-b704-f8e48a0f3817 req-b094071e-af83-4f0f-a049-ab8ce0eb48fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417aa872-dcc4-4460-99fb-d48819d6eead", "name": "network-vif-plugged", "status": "completed", "tag": "f808f4a9-93f4-4595-be63-aba89386ee2a"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:12.624909 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-c36e9b9f-bb8e-4a23-b704-f8e48a0f3817 req-b094071e-af83-4f0f-a049-ab8ce0eb48fb service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:12.625346 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-c36e9b9f-bb8e-4a23-b704-f8e48a0f3817 req-b094071e-af83-4f0f-a049-ab8ce0eb48fb service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:12.637957 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-c36e9b9f-bb8e-4a23-b704-f8e48a0f3817 req-b094071e-af83-4f0f-a049-ab8ce0eb48fb service nova] Creating event network-vif-plugged:f808f4a9-93f4-4595-be63-aba89386ee2a for instance 417aa872-dcc4-4460-99fb-d48819d6eead on hv-cinder-83754 Jul 28 18:05:12.647088 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-c36e9b9f-bb8e-4a23-b704-f8e48a0f3817 req-b094071e-af83-4f0f-a049-ab8ce0eb48fb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037037 Jul 28 18:05:12.647741 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 217/435] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:05:12.742812 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:12.751950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6d2b3b3b-b39e-460d-a9b4-13be72663866 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:12.752638 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:12.754452 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:12.755806 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6f06e915-4f81-473f-ae22-1695a203adb5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.206864 Jul 28 18:05:12.758438 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 219/436] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:12 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:05:12.762567 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6d2b3b3b-b39e-460d-a9b4-13be72663866 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:12.771802 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d2b3b3b-b39e-460d-a9b4-13be72663866 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:12.772352 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d2b3b3b-b39e-460d-a9b4-13be72663866 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:12.773347 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d2b3b3b-b39e-460d-a9b4-13be72663866 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:12.773798 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6d2b3b3b-b39e-460d-a9b4-13be72663866 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:12.973028 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6d2b3b3b-b39e-460d-a9b4-13be72663866 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:12.982892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6d2b3b3b-b39e-460d-a9b4-13be72663866 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.242615 Jul 28 18:05:12.983881 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 218/437] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:12 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:13.513854 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:13.515114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:13.517289 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=4 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:13.525766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:13.526238 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:13.527043 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:13.527472 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:13.558713 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:13.559152 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:13.559607 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lazy-loading 'fault' on Instance uuid 5ae762fd-1a0b-48e7-891f-8555a4624c57 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:05:13.605592 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c67d6fcda3f4a938b2728f7ce2fc3ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834ec9d4361246999cc4e822acaa6b77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:13.613096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-19b71f96-e1d3-4626-815b-bdcd2f062825 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 200 len: 1303 microversion: 2.1 time: 0.103716 Jul 28 18:05:13.614506 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 220/438] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:13 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:13.780099 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:13.780641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:13.787705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:13.788153 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:13.788919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:13.789349 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:13.944463 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:13.955140 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:13.956666 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:13.958110 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9eed03bd-16c1-4810-8d2e-18b317e2cf74 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.182023 Jul 28 18:05:13.958830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 219/439] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:13 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:14.016317 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ccb5d9b8-8fb3-4e3e-93b0-5de54fc0cea9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:14.017726 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ccb5d9b8-8fb3-4e3e-93b0-5de54fc0cea9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:14.029172 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ccb5d9b8-8fb3-4e3e-93b0-5de54fc0cea9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:14.030417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ccb5d9b8-8fb3-4e3e-93b0-5de54fc0cea9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:14.031961 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ccb5d9b8-8fb3-4e3e-93b0-5de54fc0cea9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:14.032454 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ccb5d9b8-8fb3-4e3e-93b0-5de54fc0cea9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:14.170445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ccb5d9b8-8fb3-4e3e-93b0-5de54fc0cea9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:14.178196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ccb5d9b8-8fb3-4e3e-93b0-5de54fc0cea9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.169560 Jul 28 18:05:14.178900 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 221/440] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:14 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:14.634767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:14.635287 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] [instance: 5ae762fd-1a0b-48e7-891f-8555a4624c57] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:14.641348 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:14.641793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:14.642595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:14.643030 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:14.656460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] HTTP exception thrown: Instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 could not be found. Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Request method failure captured: Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 HTTP/1.1 Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s-DhZs0fYRnEd4a_zuCEYZUkIxQ-dHC1nlr7fHMQAIQjcjwET4s0ZXDHUvH_ienE3xIOB6dd7zwqx_dxqxy6dTTEu_HJe1HUnP4bFOqnkNR4RRojPonGow6LtQfwH72HtLNFZOCwtzTqjfQeinUk6cYZgCkqC9_MT4v3Rg0BrsxJcs Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 834ec9d4361246999cc4e822acaa6b77 Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-VolumesActionsTest-310885223 Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:05:14.658103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/834ec9d4361246999cc4e822acaa6b77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_834ec9d4361246999cc4e822acaa6b77", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/834ec9d4361246999cc4e822acaa6b77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/834ec9d4361246999cc4e822acaa6b77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-VolumesActionsTest-310885223 Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 834ec9d4361246999cc4e822acaa6b77 Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-VolumesActionsTest-310885223 Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-VolumesActionsTest-310885223-project Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 6c67d6fcda3f4a938b2728f7ce2fc3ea Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-VolumesActionsTest-310885223-project Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 could not be found. Jul 28 18:05:14.659801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '5ae762fd-1a0b-48e7-891f-8555a4624c57'} Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 could not be found. Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:05:14.661267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 could not be found. Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 could not be found. Jul 28 18:05:14.662892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:05:14.664248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] Returning 404 to user: Instance 5ae762fd-1a0b-48e7-891f-8555a4624c57 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:05:14.664248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cee8aa05-46d7-487e-be45-17b6869d0ed9 tempest-VolumesActionsTest-310885223 tempest-VolumesActionsTest-310885223-project] 10.222.0.85 "GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57" status: 404 len: 111 microversion: 2.1 time: 0.028759 Jul 28 18:05:14.664248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 220/441] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:14 2022] GET /compute/v2.1/servers/5ae762fd-1a0b-48e7-891f-8555a4624c57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:05:14.987765 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:14.993132 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:15.001649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:15.002102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:15.003054 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:15.003489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:15.189506 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:15.199486 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:15.201255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-29de63fd-13d8-4326-8b31-2c0ad20c35eb tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:15.201895 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-29de63fd-13d8-4326-8b31-2c0ad20c35eb tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:15.202299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:15.204000 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8f4c425c-cea1-4c86-9a46-01c1f6cdc6a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.220539 Jul 28 18:05:15.218037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-29de63fd-13d8-4326-8b31-2c0ad20c35eb tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:15.218534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-29de63fd-13d8-4326-8b31-2c0ad20c35eb tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:15.218905 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 222/442] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:14 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:15.219450 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-29de63fd-13d8-4326-8b31-2c0ad20c35eb tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:15.219885 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-29de63fd-13d8-4326-8b31-2c0ad20c35eb tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:15.393316 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-29de63fd-13d8-4326-8b31-2c0ad20c35eb tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:15.403585 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-29de63fd-13d8-4326-8b31-2c0ad20c35eb tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1358 microversion: 2.1 time: 0.206105 Jul 28 18:05:15.408839 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 221/443] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:15 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:16.229553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:16.230150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:16.236702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:16.237088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:16.237857 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:16.238984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:16.378033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:16.386541 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:16.388042 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:16.389217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a909aa9b-e20b-432a-9209-5cb079a1cbd8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.163593 Jul 28 18:05:16.389782 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 223/444] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:16 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:16.428299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-43700498-22c4-4677-84ac-82087abe422e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:16.428890 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-43700498-22c4-4677-84ac-82087abe422e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:16.434940 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-43700498-22c4-4677-84ac-82087abe422e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:16.435397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-43700498-22c4-4677-84ac-82087abe422e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:16.436153 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-43700498-22c4-4677-84ac-82087abe422e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:16.436585 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-43700498-22c4-4677-84ac-82087abe422e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:16.568861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-43700498-22c4-4677-84ac-82087abe422e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:16.576433 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-43700498-22c4-4677-84ac-82087abe422e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1548 microversion: 2.1 time: 0.152117 Jul 28 18:05:16.576990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 222/445] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:16 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:16.598425 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c0a6361e-eb74-47c4-91dc-a8e8ef96f0ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:16.599049 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c0a6361e-eb74-47c4-91dc-a8e8ef96f0ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:16.605158 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c0a6361e-eb74-47c4-91dc-a8e8ef96f0ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:16.605612 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c0a6361e-eb74-47c4-91dc-a8e8ef96f0ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:16.606404 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c0a6361e-eb74-47c4-91dc-a8e8ef96f0ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:16.606850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c0a6361e-eb74-47c4-91dc-a8e8ef96f0ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:16.747438 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c0a6361e-eb74-47c4-91dc-a8e8ef96f0ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:16.755672 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c0a6361e-eb74-47c4-91dc-a8e8ef96f0ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1548 microversion: 2.1 time: 0.161948 Jul 28 18:05:16.756170 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 224/446] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:16 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:16.775048 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:16.779724 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:16.780690 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Searching by: {'deleted': False, 'project_id': '39115160ca364b2590af12fccde98256'} {{(pid=130401) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 18:05:16.788071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:16.788508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:16.789298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:16.789727 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:16.885037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.multi_cell_list [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130401) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 18:05:16.984146 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-68423a03-600a-450a-9608-2a5510d01b81 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212815 Jul 28 18:05:16.984732 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 223/447] 10.222.0.85 () {58 vars in 1125 bytes} [Thu Jul 28 18:05:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:16.996821 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8f96b95e-244a-43f6-910f-4c47ba9e6850 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:16.997448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8f96b95e-244a-43f6-910f-4c47ba9e6850 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:17.003657 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f96b95e-244a-43f6-910f-4c47ba9e6850 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:17.004118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f96b95e-244a-43f6-910f-4c47ba9e6850 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:17.005013 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f96b95e-244a-43f6-910f-4c47ba9e6850 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:17.005371 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8f96b95e-244a-43f6-910f-4c47ba9e6850 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:17.136723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8f96b95e-244a-43f6-910f-4c47ba9e6850 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:17.147419 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8f96b95e-244a-43f6-910f-4c47ba9e6850 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1548 microversion: 2.1 time: 0.154013 Jul 28 18:05:17.148499 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 225/448] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:16 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:17.414628 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:17.415157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:17.421477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:17.422001 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:17.422729 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:17.423163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:17.564354 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:17.574222 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:17.575775 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:17.576962 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d2c0e8b5-3957-4e5d-87e0-97ef487846a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.166996 Jul 28 18:05:17.577557 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 224/449] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:17 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:05:18.601476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:18.602078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:18.608695 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:18.609166 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:18.609936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:18.610391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:18.754568 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:18.763314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:18.765324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:18.766764 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a4d27099-8920-4d1e-a213-9432b1d981bf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.169625 Jul 28 18:05:18.767396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 226/450] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:18 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:19.134043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f198a93f-d6b9-4d52-864c-86dbe54c661a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "525ac05d-0d55-445c-8094-4acb508d7aed"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:19.136494 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f198a93f-d6b9-4d52-864c-86dbe54c661a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:19.142757 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f198a93f-d6b9-4d52-864c-86dbe54c661a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:19.143356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f198a93f-d6b9-4d52-864c-86dbe54c661a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:19.143967 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f198a93f-d6b9-4d52-864c-86dbe54c661a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:19.145018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f198a93f-d6b9-4d52-864c-86dbe54c661a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:19.793423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:19.794026 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:19.801339 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:19.802074 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:19.802996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:19.810462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:19.862111 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:19.945474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:19.956697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:19.958391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:19.959831 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7a017a79-00ce-49e2-80ea-5280684d030d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.170268 Jul 28 18:05:19.960472 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 227/451] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:19 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:05:19.991436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f198a93f-d6b9-4d52-864c-86dbe54c661a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "POST /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.861335 Jul 28 18:05:19.992162 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 225/452] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:05:19 2022] POST /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:20.987146 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:20.987750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:20.994888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:20.995332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:20.996103 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:20.996530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:21.138606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:21.149344 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:21.150972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:21.152283 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c951dd8d-8da8-420d-a7d0-9e05480053ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.169034 Jul 28 18:05:21.152878 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 228/453] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:20 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:22.178665 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:22.179737 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:22.187639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:22.188088 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:22.188859 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:22.189296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:22.349431 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:22.363930 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:22.366825 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:22.368082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4719464c-2646-47da-bffe-7765a4555ec9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.194959 Jul 28 18:05:22.368633 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 226/454] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:22 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:23.392975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:23.393599 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:23.401371 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:23.401881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:23.402748 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:23.403186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:23.559647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:23.568824 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:23.570337 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:23.571530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8ba4fb77-9d40-4546-9ac7-9b30dae538ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.183249 Jul 28 18:05:23.572100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 229/455] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:23 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:24.601429 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:24.602100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:24.608940 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:24.609488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:24.610254 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:24.610715 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:24.772385 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:24.780809 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:24.782298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:24.783478 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-eb9446ec-54e1-457b-baeb-0ae17056c346 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.186260 Jul 28 18:05:24.784070 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 227/456] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:24 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:25.602010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:05:25.602645 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Thu Jul 28 18:05:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:05:25.807695 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:25.808286 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:25.814899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:25.815488 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:25.816310 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:25.816729 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:25.838445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:25.971288 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:25.981019 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:25.982523 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:25.983673 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c89df62f-ca09-4b0b-81fb-86b378acb27b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.179968 Jul 28 18:05:25.984215 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 230/457] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:25 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:27.013407 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:27.014052 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:27.016687 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:27.022336 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:27.027835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:27.027835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:27.027835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:27.165867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:27.174331 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:27.175887 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:27.177054 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5017df26-0a30-490f-9823-58a180b5897e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.167839 Jul 28 18:05:27.177606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 228/458] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:27 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:28.200227 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:28.200818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:28.203117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:28.209130 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:28.209566 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:28.210340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:28.215019 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:28.347843 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:28.356392 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:28.357878 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:28.359068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0a6d22f4-a72b-4cff-a1ad-687f50d32515 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.162847 Jul 28 18:05:28.359615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 231/459] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:28 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:29.388525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:29.390226 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:29.401126 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:29.402048 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:29.403186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:29.403919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:29.575830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:29.586277 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:29.596812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:29.598228 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b4bb2305-a535-4114-9b1e-27c8eb04eec1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.216817 Jul 28 18:05:29.599040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 229/460] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:29 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:05:30.625689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:30.626631 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:30.633527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:30.633980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:30.634818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:30.635256 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:30.840175 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:30.851229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:30.852761 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:30.853975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-799c147f-01c5-492d-8910-4b1b2db8e842 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.232661 Jul 28 18:05:30.854898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 232/461] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:30 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:31.884885 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:31.886692 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:31.898442 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:31.904204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:31.904204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:31.904204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:32.074173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:32.082756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:32.084245 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:32.085461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b7c8992d-f65b-45c6-be52-940f28b9fdcd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.208174 Jul 28 18:05:32.086006 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 230/462] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:31 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:33.114823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:33.114823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:33.125506 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:33.125957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:33.127015 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:33.127650 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:33.313585 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:33.324864 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:33.326711 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:33.328131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-04499592-b6de-4266-8f53-551917073100 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.222664 Jul 28 18:05:33.328613 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 233/463] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:33 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:34.356261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:34.356874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:34.384109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:34.390171 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:34.391413 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:34.391969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:34.590605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:34.621863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:34.621863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:34.621863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4960a7c6-0f95-4f9a-9e58-38759f248bdb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.270697 Jul 28 18:05:34.644396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 231/464] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:34 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:35.649751 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:35.652082 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:35.662423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:35.663792 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:35.665198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:35.665981 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:35.912198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:35.926669 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:35.929761 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:35.932217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-413c7363-d206-4758-b17c-3f1cd5401588 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.289703 Jul 28 18:05:35.933396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 234/465] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:35 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:36.957170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:36.958699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:36.971052 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:36.973497 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:36.973497 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:36.973983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:37.190507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:37.304510 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:37.306077 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:37.307480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f5bc352a-8887-4979-bae6-511a11ec3728 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.354872 Jul 28 18:05:37.309734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 232/466] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:36 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:05:38.352344 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:38.352970 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:38.368726 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:38.369191 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:38.370024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:38.370680 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:38.663829 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:38.673252 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:38.675532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:38.676790 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-da6286fc-7fa2-4736-ba53-2e0e22ff2881 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.328883 Jul 28 18:05:38.677704 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 235/467] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:38 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:39.699771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:39.700451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:39.709040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:39.709484 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:39.710238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:39.710702 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:39.848453 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:39.857234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:39.858740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:39.859888 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-af09e526-e728-4c85-986c-f9df5d735c69 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.163924 Jul 28 18:05:39.860431 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 233/468] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:39 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:40.884572 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:40.885215 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:40.891796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:40.892278 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:40.893065 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:40.894094 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:41.030481 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:41.039553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:41.041085 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:41.042245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5132ccb7-7440-4237-9cd3-767047bc3917 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.161877 Jul 28 18:05:41.042832 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 236/469] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:40 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:41.984560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-02032369-4cab-4472-848f-7d17504d133d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:41.985248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-02032369-4cab-4472-848f-7d17504d133d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:41.988686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:41.993891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-02032369-4cab-4472-848f-7d17504d133d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:41.994376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-02032369-4cab-4472-848f-7d17504d133d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:41.995142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-02032369-4cab-4472-848f-7d17504d133d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:41.995593 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-02032369-4cab-4472-848f-7d17504d133d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:42.067593 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:42.068880 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:42.076770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:42.077698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:42.078725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:42.080016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:42.137623 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-02032369-4cab-4472-848f-7d17504d133d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:42.146735 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-02032369-4cab-4472-848f-7d17504d133d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1594 microversion: 2.1 time: 0.166122 Jul 28 18:05:42.147260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 234/470] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:41 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1594 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:42.249121 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:42.259000 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:42.261299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:42.262706 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5f53350a-a69a-4c51-913f-f34469ee5cba tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.200039 Jul 28 18:05:42.263453 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 237/471] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:42 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:43.289168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:43.290666 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:43.298834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:43.299864 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:43.301419 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:43.302103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:43.766599 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:43.780883 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:43.785402 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:43.786750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-83490e7b-3214-4b56-9871-8bd884a42e42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.502194 Jul 28 18:05:43.787321 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 235/472] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:43 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:44.810725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:44.811367 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:44.818370 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:44.819183 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:44.820037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:44.820500 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:45.002475 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:45.012464 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:45.014460 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:45.016098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-60eb90ed-cfda-4291-b758-be527fb5fbde tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.209257 Jul 28 18:05:45.016916 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 238/473] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:44 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:45.077445 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-a488eab6-27c0-481b-9c7e-00b01fae124e req-31db71ba-4239-4958-8878-9e92884ab6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417aa872-dcc4-4460-99fb-d48819d6eead", "tag": "f808f4a9-93f4-4595-be63-aba89386ee2a"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:45.093942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-a488eab6-27c0-481b-9c7e-00b01fae124e req-31db71ba-4239-4958-8878-9e92884ab6ef service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:45.096634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-a488eab6-27c0-481b-9c7e-00b01fae124e req-31db71ba-4239-4958-8878-9e92884ab6ef service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:45.110703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-a488eab6-27c0-481b-9c7e-00b01fae124e req-31db71ba-4239-4958-8878-9e92884ab6ef service nova] Creating event network-changed:f808f4a9-93f4-4595-be63-aba89386ee2a for instance 417aa872-dcc4-4460-99fb-d48819d6eead on hv-cinder-83754 Jul 28 18:05:45.117438 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-a488eab6-27c0-481b-9c7e-00b01fae124e req-31db71ba-4239-4958-8878-9e92884ab6ef service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043668 Jul 28 18:05:45.118031 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 236/474] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:46.042975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:46.042975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:46.059533 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:46.060141 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:46.061088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:46.061748 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:46.305011 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:46.317431 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:46.319259 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:46.320615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5096da49-234e-4c48-9a07-0a4f6ec7a079 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.283256 Jul 28 18:05:46.331391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 239/475] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:46 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:47.345439 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:47.346437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:47.366763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:47.367485 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:47.368603 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:47.369209 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:47.568219 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:47.580173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:47.582049 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:47.583374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c910b27b-7e01-42f9-8010-e427de64b820 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.242570 Jul 28 18:05:47.583928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 237/476] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:47 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:48.349229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-95ce60e0-4285-42aa-8874-726526862fc6 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-386670491"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:48.349915 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-95ce60e0-4285-42aa-8874-726526862fc6 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:48.356439 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-95ce60e0-4285-42aa-8874-726526862fc6 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:48.356887 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-95ce60e0-4285-42aa-8874-726526862fc6 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:48.357651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-95ce60e0-4285-42aa-8874-726526862fc6 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:48.358081 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-95ce60e0-4285-42aa-8874-726526862fc6 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:48.518991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.network.security_group_api [None req-95ce60e0-4285-42aa-8874-726526862fc6 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Adding security group ee8d2197-d7cb-4353-9736-921a854afbcd to port f808f4a9-93f4-4595-be63-aba89386ee2a Jul 28 18:05:48.608999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:48.610254 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:48.623418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:48.625717 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:48.628833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:48.629660 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:48.803850 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:48.816465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:48.840119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:48.844078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ea7e579a-6c61-4029-81db-271a31b1a6e9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.240016 Jul 28 18:05:48.852117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 238/477] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:48 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:05:49.125868 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-9f225645-2bca-4f1a-8cf2-927d9cf9de00 req-d56cdb63-ffae-4f13-9e9b-5a9d8642af85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417aa872-dcc4-4460-99fb-d48819d6eead", "tag": "f808f4a9-93f4-4595-be63-aba89386ee2a"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:49.126575 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-95ce60e0-4285-42aa-8874-726526862fc6 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "POST /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/action" status: 202 len: 0 microversion: 2.1 time: 0.772981 Jul 28 18:05:49.127800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 240/478] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:05:48 2022] POST /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:05:49.137271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ac423358-1a9e-43b5-9538-1fa34a50e6e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:49.138210 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ac423358-1a9e-43b5-9538-1fa34a50e6e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:49.145904 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac423358-1a9e-43b5-9538-1fa34a50e6e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:49.146772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac423358-1a9e-43b5-9538-1fa34a50e6e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:49.148048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac423358-1a9e-43b5-9538-1fa34a50e6e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:49.148415 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac423358-1a9e-43b5-9538-1fa34a50e6e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:49.151396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-9f225645-2bca-4f1a-8cf2-927d9cf9de00 req-d56cdb63-ffae-4f13-9e9b-5a9d8642af85 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:49.152103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-9f225645-2bca-4f1a-8cf2-927d9cf9de00 req-d56cdb63-ffae-4f13-9e9b-5a9d8642af85 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:49.167413 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-9f225645-2bca-4f1a-8cf2-927d9cf9de00 req-d56cdb63-ffae-4f13-9e9b-5a9d8642af85 service nova] Creating event network-changed:f808f4a9-93f4-4595-be63-aba89386ee2a for instance 417aa872-dcc4-4460-99fb-d48819d6eead on hv-cinder-83754 Jul 28 18:05:49.180197 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-9f225645-2bca-4f1a-8cf2-927d9cf9de00 req-d56cdb63-ffae-4f13-9e9b-5a9d8642af85 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057867 Jul 28 18:05:49.181446 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 239/479] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:49.429619 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ac423358-1a9e-43b5-9538-1fa34a50e6e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:49.439561 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ac423358-1a9e-43b5-9538-1fa34a50e6e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1759 microversion: 2.1 time: 0.307141 Jul 28 18:05:49.457149 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 241/480] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:49 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1759 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:05:49.871864 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:49.873258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:49.891904 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:49.895475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:49.895475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:49.895475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:50.119031 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:50.131177 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:50.134003 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:50.136652 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-65532679-9555-4150-b7a6-5dcedd0cc8d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.269612 Jul 28 18:05:50.137832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 240/481] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:49 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:50.672483 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1017506389", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1518406974", "security_groups": [{"name": "tempest-secgroup-smoke-1342836541"}], "block_device_mapping_v2": [{"uuid": "907fd795-415c-440b-8945-e8148fd7978b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2745d657-8db7-4817-b0a4-814cddf7a093"}]}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:50.804825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] validate_networks() for [('2745d657-8db7-4817-b0a4-814cddf7a093', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:05:51.200728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-0c44fe5d-17d3-40d1-83c8-2c5fb87ae569 req-5d296d6a-9cfe-41bc-bb74-4d57f8f9480e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f64c566-cf5d-4240-95e2-c5746a5bba89", "name": "network-vif-plugged", "status": "completed", "tag": "8980c8f3-7810-4b7b-b88d-1b866e291a34"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:51.259120 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-0c44fe5d-17d3-40d1-83c8-2c5fb87ae569 req-5d296d6a-9cfe-41bc-bb74-4d57f8f9480e service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:51.267132 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-0c44fe5d-17d3-40d1-83c8-2c5fb87ae569 req-5d296d6a-9cfe-41bc-bb74-4d57f8f9480e service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:51.305101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-0c44fe5d-17d3-40d1-83c8-2c5fb87ae569 req-5d296d6a-9cfe-41bc-bb74-4d57f8f9480e service nova] Creating event network-vif-plugged:8980c8f3-7810-4b7b-b88d-1b866e291a34 for instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 on hv-cinder-83754 Jul 28 18:05:51.312196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-0c44fe5d-17d3-40d1-83c8-2c5fb87ae569 req-5d296d6a-9cfe-41bc-bb74-4d57f8f9480e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136262 Jul 28 18:05:51.313126 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 241/482] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:51.322187 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:51.323498 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:51.330174 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:51.330757 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:51.331543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:51.331978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:51.350450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:05:51.351167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:05:51.352120 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:05:51.352575 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:05:51.353123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:05:51.389710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:51.391906 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:51.395385 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:51.396441 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:51.422962 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Getting quotas for project a1b1e6abd55a4b17b4a452a80a6bbdbc. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:05:51.435299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Getting quotas for user 73edfd05da254457b6ad9c9c9f662e4c and project a1b1e6abd55a4b17b4a452a80a6bbdbc. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:05:51.552986 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:05:51.555311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='907fd795-415c-440b-8945-e8148fd7978b',volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:05:51.589472 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:51.609718 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:51.614251 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:51.615696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a5850375-9022-4dd1-866a-05fdfc0e2d61 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.298172 Jul 28 18:05:51.618719 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 242/483] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:51 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:51.776609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0af1ec79-8dd9-4b8e-8916-0fd4ffef8cc8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "722a33d4-f760-494c-88c8-753c03acc0b8"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:05:51.779777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0af1ec79-8dd9-4b8e-8916-0fd4ffef8cc8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:51.786321 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0af1ec79-8dd9-4b8e-8916-0fd4ffef8cc8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:51.787046 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0af1ec79-8dd9-4b8e-8916-0fd4ffef8cc8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:51.788236 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0af1ec79-8dd9-4b8e-8916-0fd4ffef8cc8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:51.788979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0af1ec79-8dd9-4b8e-8916-0fd4ffef8cc8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:52.149938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ac33976a-d3c3-48f3-99ce-6df7af716e9f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.480033 Jul 28 18:05:52.149938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 242/484] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:05:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:05:52.216333 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3a79139b-4717-4ba6-9321-c317bee6575f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:52.216504 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3a79139b-4717-4ba6-9321-c317bee6575f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:52.328377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3a79139b-4717-4ba6-9321-c317bee6575f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:52.335869 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3a79139b-4717-4ba6-9321-c317bee6575f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1095 microversion: 2.1 time: 0.135129 Jul 28 18:05:52.336444 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 243/485] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:52 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1095 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:52.642980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:52.643873 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:52.653381 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:52.654627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:52.655944 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:52.656871 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:52.792683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:52.950144 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0af1ec79-8dd9-4b8e-8916-0fd4ffef8cc8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.177381 Jul 28 18:05:52.950795 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 243/486] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:05:51 2022] POST /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments => generated 194 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:05:53.196622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:53.210310 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:53.212314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:53.213701 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e7a8ea1a-1437-4c57-aa11-6078971b65ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.575892 Jul 28 18:05:53.214257 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 244/487] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:52 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:53.359323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-920c09c7-8aaf-4d45-8c0f-9b7de39b23b4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:53.360320 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-920c09c7-8aaf-4d45-8c0f-9b7de39b23b4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:53.450387 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-920c09c7-8aaf-4d45-8c0f-9b7de39b23b4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:53.458791 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-920c09c7-8aaf-4d45-8c0f-9b7de39b23b4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1095 microversion: 2.1 time: 0.105105 Jul 28 18:05:53.459944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 244/488] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:53 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1095 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:54.239887 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:54.240513 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:54.247719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:54.248164 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:54.257182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:54.257691 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:54.417962 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:54.429785 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:54.432247 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:54.433418 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a3919a98-8c87-48a9-ba38-6833c9036ad8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.197948 Jul 28 18:05:54.433972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 245/489] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:54 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:54.482072 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-38b9059c-25e3-44dd-9e92-8133e07e4d59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:54.482072 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-38b9059c-25e3-44dd-9e92-8133e07e4d59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:54.489312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-38b9059c-25e3-44dd-9e92-8133e07e4d59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:54.489765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-38b9059c-25e3-44dd-9e92-8133e07e4d59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:54.490644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-38b9059c-25e3-44dd-9e92-8133e07e4d59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:54.491214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-38b9059c-25e3-44dd-9e92-8133e07e4d59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:54.562696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-38b9059c-25e3-44dd-9e92-8133e07e4d59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:54.571326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-38b9059c-25e3-44dd-9e92-8133e07e4d59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1137 microversion: 2.1 time: 0.094557 Jul 28 18:05:54.571890 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 245/490] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:54 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1137 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:55.458018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:55.458664 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:55.465791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:55.466244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:55.467239 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:55.467676 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:55.591804 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d382c7c0-f13f-4bdf-9790-fdc3cba5f080 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:55.592497 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d382c7c0-f13f-4bdf-9790-fdc3cba5f080 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:55.599214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d382c7c0-f13f-4bdf-9790-fdc3cba5f080 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:55.599863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d382c7c0-f13f-4bdf-9790-fdc3cba5f080 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:55.601061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d382c7c0-f13f-4bdf-9790-fdc3cba5f080 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:55.601492 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d382c7c0-f13f-4bdf-9790-fdc3cba5f080 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:55.608752 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:55.618719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:55.620340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:55.621417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3259e038-6449-4784-9c72-9a78c22d6f95 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.168090 Jul 28 18:05:55.622165 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 246/491] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:55 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:55.670594 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d382c7c0-f13f-4bdf-9790-fdc3cba5f080 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:55.679227 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d382c7c0-f13f-4bdf-9790-fdc3cba5f080 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1193 microversion: 2.1 time: 0.091211 Jul 28 18:05:55.679769 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 246/492] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:55 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:05:56.647693 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:56.648318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:56.655005 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:56.655462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:56.656462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:56.656905 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:56.660077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=87 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:56.700025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-80cd9dfe-2104-4003-bc39-81b6527baa74 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:56.700839 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-80cd9dfe-2104-4003-bc39-81b6527baa74 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:56.710437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-80cd9dfe-2104-4003-bc39-81b6527baa74 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:56.714210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-80cd9dfe-2104-4003-bc39-81b6527baa74 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:56.714210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-80cd9dfe-2104-4003-bc39-81b6527baa74 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:56.714210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-80cd9dfe-2104-4003-bc39-81b6527baa74 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:56.776593 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-80cd9dfe-2104-4003-bc39-81b6527baa74 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:56.785605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-80cd9dfe-2104-4003-bc39-81b6527baa74 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1193 microversion: 2.1 time: 0.089337 Jul 28 18:05:56.786813 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 247/493] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:56 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:05:56.804238 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:56.813024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:56.814871 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:56.815985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-53fb4c60-cca8-4a2b-90f5-8b224845400b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.172339 Jul 28 18:05:56.816533 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 247/494] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:56 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:05:57.807391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f28836a3-cf7b-43b0-80ad-dd78a8fa4fe7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:57.808007 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f28836a3-cf7b-43b0-80ad-dd78a8fa4fe7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:57.814795 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f28836a3-cf7b-43b0-80ad-dd78a8fa4fe7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:57.815463 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f28836a3-cf7b-43b0-80ad-dd78a8fa4fe7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:57.816256 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f28836a3-cf7b-43b0-80ad-dd78a8fa4fe7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:57.816689 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f28836a3-cf7b-43b0-80ad-dd78a8fa4fe7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:57.842664 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:57.844421 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:57.853608 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:57.854052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:57.854850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:57.855736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:57.907142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f28836a3-cf7b-43b0-80ad-dd78a8fa4fe7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:57.923210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f28836a3-cf7b-43b0-80ad-dd78a8fa4fe7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1193 microversion: 2.1 time: 0.119732 Jul 28 18:05:57.923838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 248/495] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:57 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1193 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:58.018342 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:58.027117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:58.028654 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:58.029822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9ef5e916-cd14-4f0e-91c8-17c224097a12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1809 microversion: 2.20 time: 0.192919 Jul 28 18:05:58.030407 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 248/496] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:57 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:05:58.943590 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-878eca02-5a5d-4020-8b27-bbf787fe6784 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:58.944218 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-878eca02-5a5d-4020-8b27-bbf787fe6784 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:58.950939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-878eca02-5a5d-4020-8b27-bbf787fe6784 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:58.954542 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-878eca02-5a5d-4020-8b27-bbf787fe6784 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:58.954542 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-878eca02-5a5d-4020-8b27-bbf787fe6784 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:58.954542 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-878eca02-5a5d-4020-8b27-bbf787fe6784 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:59.024997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-878eca02-5a5d-4020-8b27-bbf787fe6784 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:59.032623 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-878eca02-5a5d-4020-8b27-bbf787fe6784 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1211 microversion: 2.1 time: 0.092978 Jul 28 18:05:59.034075 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 249/497] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:05:58 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1211 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:05:59.054185 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:05:59.054829 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:05:59.057311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:05:59.062364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:59.065398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:59.065398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:05:59.065398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:05:59.204223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:59.213663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:59.215173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:05:59.216319 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-96e2aadf-655d-467d-9b47-e9b6b9ec9238 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1796 microversion: 2.20 time: 0.166011 Jul 28 18:05:59.216873 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 249/498] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:05:59 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1796 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:00.056893 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b3a6badc-34f3-4bfa-a3c6-ee98c774a775 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:00.059334 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b3a6badc-34f3-4bfa-a3c6-ee98c774a775 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:00.073156 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b3a6badc-34f3-4bfa-a3c6-ee98c774a775 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:00.101991 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b3a6badc-34f3-4bfa-a3c6-ee98c774a775 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:00.101991 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b3a6badc-34f3-4bfa-a3c6-ee98c774a775 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:00.101991 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b3a6badc-34f3-4bfa-a3c6-ee98c774a775 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:00.310469 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b3a6badc-34f3-4bfa-a3c6-ee98c774a775 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:00.317968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b3a6badc-34f3-4bfa-a3c6-ee98c774a775 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.265479 Jul 28 18:06:00.318580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 250/499] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:00 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:00.628029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-3d787930-35ac-4953-8414-f2ba8054e025 req-73f87051-5ab0-4f0f-b52b-e6a993be3bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1642e2-8e19-4214-8ada-503d731de538", "tag": "e04a6944-3588-4a0b-9a97-45eafc96eeed"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:00.640324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-3d787930-35ac-4953-8414-f2ba8054e025 req-73f87051-5ab0-4f0f-b52b-e6a993be3bf6 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:00.640772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-3d787930-35ac-4953-8414-f2ba8054e025 req-73f87051-5ab0-4f0f-b52b-e6a993be3bf6 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:00.655021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-3d787930-35ac-4953-8414-f2ba8054e025 req-73f87051-5ab0-4f0f-b52b-e6a993be3bf6 service nova] Creating event network-changed:e04a6944-3588-4a0b-9a97-45eafc96eeed for instance 1f1642e2-8e19-4214-8ada-503d731de538 on hv-cinder-83754 Jul 28 18:06:00.661463 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-3d787930-35ac-4953-8414-f2ba8054e025 req-73f87051-5ab0-4f0f-b52b-e6a993be3bf6 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037663 Jul 28 18:06:00.662178 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 250/500] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:01.337962 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3e7b9125-f7ee-40b4-9640-e0f1ca4b3fec tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:01.338674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3e7b9125-f7ee-40b4-9640-e0f1ca4b3fec tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:01.345137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3e7b9125-f7ee-40b4-9640-e0f1ca4b3fec tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:01.345750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3e7b9125-f7ee-40b4-9640-e0f1ca4b3fec tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:01.346692 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3e7b9125-f7ee-40b4-9640-e0f1ca4b3fec tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:01.347130 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3e7b9125-f7ee-40b4-9640-e0f1ca4b3fec tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:01.537852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-3e7b9125-f7ee-40b4-9640-e0f1ca4b3fec tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:01.545370 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3e7b9125-f7ee-40b4-9640-e0f1ca4b3fec tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.211296 Jul 28 18:06:01.545930 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 251/501] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:01 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:01.979997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:01.984861 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1790835437", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "networks": [{"uuid": "01c55f50-a315-477f-80d3-c30431bfaa68"}]}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:02.039595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] validate_networks() for [('01c55f50-a315-477f-80d3-c30431bfaa68', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:06:02.333326 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=8 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:02.414379 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:06:02.414815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:06:02.415285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:06:02.415695 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:06:02.416108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:06:02.425056 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:02.425498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:02.426299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:02.426759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:02.443167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Getting quotas for project 613c6d4f37814a209077ac2c19506674. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:06:02.447164 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Getting quotas for user aa7941170fe74f9c818f4ab612fca33f and project 613c6d4f37814a209077ac2c19506674. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:06:02.458902 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:06:02.461350 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:06:02.567694 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d014923b-4b08-4839-b74d-2f65e4898883 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:02.568404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d014923b-4b08-4839-b74d-2f65e4898883 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:02.574991 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d014923b-4b08-4839-b74d-2f65e4898883 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:02.575441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d014923b-4b08-4839-b74d-2f65e4898883 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:02.576280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d014923b-4b08-4839-b74d-2f65e4898883 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:02.576719 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d014923b-4b08-4839-b74d-2f65e4898883 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:02.613918 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-26d350fc-4572-4307-975d-e969527eaab9 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634598 Jul 28 18:06:02.617710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 251/502] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:06:02.633765 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4570e400-f867-4cd7-8503-99816871a00e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:02.634617 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4570e400-f867-4cd7-8503-99816871a00e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:02.710495 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4570e400-f867-4cd7-8503-99816871a00e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:02.718834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4570e400-f867-4cd7-8503-99816871a00e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1219 microversion: 2.1 time: 0.094059 Jul 28 18:06:02.733725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 252/503] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:02 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:02.745783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d014923b-4b08-4839-b74d-2f65e4898883 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:02.760580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d014923b-4b08-4839-b74d-2f65e4898883 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.196957 Jul 28 18:06:02.771847 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 252/504] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:02 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:03.742380 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b6ad443c-d5c3-44d2-ac59-4d7c21c7049c tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:03.742928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b6ad443c-d5c3-44d2-ac59-4d7c21c7049c tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:03.782926 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2c2d7647-c311-42ad-aa12-d36a44078fb4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:03.783700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2c2d7647-c311-42ad-aa12-d36a44078fb4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:03.785609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:03.792129 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2c2d7647-c311-42ad-aa12-d36a44078fb4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:03.792593 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2c2d7647-c311-42ad-aa12-d36a44078fb4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:03.793376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2c2d7647-c311-42ad-aa12-d36a44078fb4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:03.793815 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2c2d7647-c311-42ad-aa12-d36a44078fb4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:03.798642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b6ad443c-d5c3-44d2-ac59-4d7c21c7049c tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:03.805689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b6ad443c-d5c3-44d2-ac59-4d7c21c7049c tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1219 microversion: 2.1 time: 0.067355 Jul 28 18:06:03.806371 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 253/505] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:03 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:03.936352 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2c2d7647-c311-42ad-aa12-d36a44078fb4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:03.945300 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2c2d7647-c311-42ad-aa12-d36a44078fb4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.166604 Jul 28 18:06:03.954593 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 253/506] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:03 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:04.828058 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9d29e42b-c185-48ab-a2fc-6c745e2a490e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:04.829360 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9d29e42b-c185-48ab-a2fc-6c745e2a490e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:04.843547 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d29e42b-c185-48ab-a2fc-6c745e2a490e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:04.844002 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d29e42b-c185-48ab-a2fc-6c745e2a490e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:04.845623 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d29e42b-c185-48ab-a2fc-6c745e2a490e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:04.845875 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9d29e42b-c185-48ab-a2fc-6c745e2a490e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:04.923338 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9d29e42b-c185-48ab-a2fc-6c745e2a490e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:04.931078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9d29e42b-c185-48ab-a2fc-6c745e2a490e tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.107388 Jul 28 18:06:04.931644 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 254/507] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:04 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:04.967822 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-81757dce-bebd-4258-a78c-be8b13e55d07 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:04.968431 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-81757dce-bebd-4258-a78c-be8b13e55d07 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:04.976187 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-81757dce-bebd-4258-a78c-be8b13e55d07 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:04.976867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-81757dce-bebd-4258-a78c-be8b13e55d07 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:04.978155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-81757dce-bebd-4258-a78c-be8b13e55d07 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:04.978794 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-81757dce-bebd-4258-a78c-be8b13e55d07 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:05.164808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-81757dce-bebd-4258-a78c-be8b13e55d07 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:05.173541 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-81757dce-bebd-4258-a78c-be8b13e55d07 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.210323 Jul 28 18:06:05.174276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 254/508] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:04 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:05.952205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2ddd7ed8-7a94-47b6-b657-a9feb4583b02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:05.952815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2ddd7ed8-7a94-47b6-b657-a9feb4583b02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:05.959900 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ddd7ed8-7a94-47b6-b657-a9feb4583b02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:05.962883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ddd7ed8-7a94-47b6-b657-a9feb4583b02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:05.962883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ddd7ed8-7a94-47b6-b657-a9feb4583b02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:05.962883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ddd7ed8-7a94-47b6-b657-a9feb4583b02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:06.025941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2ddd7ed8-7a94-47b6-b657-a9feb4583b02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:06.034751 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2ddd7ed8-7a94-47b6-b657-a9feb4583b02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.086047 Jul 28 18:06:06.035343 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 255/509] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:05 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:06.194611 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fc5e24bb-aa05-4ea7-b207-54030ba4be30 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:06.195163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-fc5e24bb-aa05-4ea7-b207-54030ba4be30 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:06.201745 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fc5e24bb-aa05-4ea7-b207-54030ba4be30 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:06.206639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fc5e24bb-aa05-4ea7-b207-54030ba4be30 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:06.206639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fc5e24bb-aa05-4ea7-b207-54030ba4be30 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:06.206639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fc5e24bb-aa05-4ea7-b207-54030ba4be30 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:06.342634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-fc5e24bb-aa05-4ea7-b207-54030ba4be30 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:06.350203 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fc5e24bb-aa05-4ea7-b207-54030ba4be30 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.159466 Jul 28 18:06:06.350801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 255/510] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:06 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:07.055402 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-54e8ab9d-2675-489d-99ba-f1088f34d227 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:07.056016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-54e8ab9d-2675-489d-99ba-f1088f34d227 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:07.063584 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-54e8ab9d-2675-489d-99ba-f1088f34d227 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:07.063826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-54e8ab9d-2675-489d-99ba-f1088f34d227 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:07.064675 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-54e8ab9d-2675-489d-99ba-f1088f34d227 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:07.065117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-54e8ab9d-2675-489d-99ba-f1088f34d227 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:07.149359 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-54e8ab9d-2675-489d-99ba-f1088f34d227 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:07.157742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-54e8ab9d-2675-489d-99ba-f1088f34d227 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.105599 Jul 28 18:06:07.158576 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 256/511] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:07 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:07.371819 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b560d793-44fe-4211-b067-bc8db1d3584c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:07.372508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b560d793-44fe-4211-b067-bc8db1d3584c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:07.379870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b560d793-44fe-4211-b067-bc8db1d3584c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:07.380321 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b560d793-44fe-4211-b067-bc8db1d3584c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:07.381087 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b560d793-44fe-4211-b067-bc8db1d3584c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:07.381513 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b560d793-44fe-4211-b067-bc8db1d3584c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:07.561203 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b560d793-44fe-4211-b067-bc8db1d3584c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:07.572089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b560d793-44fe-4211-b067-bc8db1d3584c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.204288 Jul 28 18:06:07.572668 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 256/512] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:07 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:08.179462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3b026851-ab50-4963-b319-ac2a4087e59b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:08.180073 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3b026851-ab50-4963-b319-ac2a4087e59b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:08.187247 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b026851-ab50-4963-b319-ac2a4087e59b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:08.188099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b026851-ab50-4963-b319-ac2a4087e59b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:08.199969 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b026851-ab50-4963-b319-ac2a4087e59b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:08.200683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b026851-ab50-4963-b319-ac2a4087e59b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:08.273563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3b026851-ab50-4963-b319-ac2a4087e59b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:08.281284 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3b026851-ab50-4963-b319-ac2a4087e59b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.105815 Jul 28 18:06:08.282790 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 257/513] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:08 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:08.595234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4d523a11-3809-4e36-ae22-a8143d8779e8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:08.596506 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4d523a11-3809-4e36-ae22-a8143d8779e8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:08.603050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d523a11-3809-4e36-ae22-a8143d8779e8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:08.603492 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d523a11-3809-4e36-ae22-a8143d8779e8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:08.604254 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d523a11-3809-4e36-ae22-a8143d8779e8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:08.604679 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4d523a11-3809-4e36-ae22-a8143d8779e8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:08.842374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4d523a11-3809-4e36-ae22-a8143d8779e8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:08.864228 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4d523a11-3809-4e36-ae22-a8143d8779e8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.273396 Jul 28 18:06:08.877497 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 257/514] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:08 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:09.302605 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5c6f9141-2597-4162-b89f-6ad482640fda tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:09.303228 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5c6f9141-2597-4162-b89f-6ad482640fda tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:09.310164 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c6f9141-2597-4162-b89f-6ad482640fda tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:09.310911 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c6f9141-2597-4162-b89f-6ad482640fda tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:09.311882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c6f9141-2597-4162-b89f-6ad482640fda tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:09.312525 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c6f9141-2597-4162-b89f-6ad482640fda tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:09.388012 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5c6f9141-2597-4162-b89f-6ad482640fda tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:09.396531 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5c6f9141-2597-4162-b89f-6ad482640fda tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.097666 Jul 28 18:06:09.397118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 258/515] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:09 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:09.885094 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d3604ff4-7315-4009-9f28-b99753153d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:09.885724 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d3604ff4-7315-4009-9f28-b99753153d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:09.893302 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d3604ff4-7315-4009-9f28-b99753153d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:09.893755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d3604ff4-7315-4009-9f28-b99753153d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:09.894566 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d3604ff4-7315-4009-9f28-b99753153d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:09.894999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d3604ff4-7315-4009-9f28-b99753153d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:10.094605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d3604ff4-7315-4009-9f28-b99753153d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:10.102686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d3604ff4-7315-4009-9f28-b99753153d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.221384 Jul 28 18:06:10.103560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 258/516] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:09 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:10.419526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b931ec78-2d6c-41a4-9b44-d0236c6dfd14 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:10.420773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b931ec78-2d6c-41a4-9b44-d0236c6dfd14 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:10.427714 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b931ec78-2d6c-41a4-9b44-d0236c6dfd14 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:10.428168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b931ec78-2d6c-41a4-9b44-d0236c6dfd14 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:10.428945 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b931ec78-2d6c-41a4-9b44-d0236c6dfd14 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:10.429384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b931ec78-2d6c-41a4-9b44-d0236c6dfd14 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:10.498638 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b931ec78-2d6c-41a4-9b44-d0236c6dfd14 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:10.508091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b931ec78-2d6c-41a4-9b44-d0236c6dfd14 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.092628 Jul 28 18:06:10.508865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 259/517] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:10 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:11.123873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-acf241d6-7345-4a73-9bb2-dad4086b2e6f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:11.124624 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-acf241d6-7345-4a73-9bb2-dad4086b2e6f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:11.131953 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-acf241d6-7345-4a73-9bb2-dad4086b2e6f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:11.132487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-acf241d6-7345-4a73-9bb2-dad4086b2e6f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:11.133327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-acf241d6-7345-4a73-9bb2-dad4086b2e6f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:11.134068 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-acf241d6-7345-4a73-9bb2-dad4086b2e6f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:11.287221 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-acf241d6-7345-4a73-9bb2-dad4086b2e6f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:11.295410 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-acf241d6-7345-4a73-9bb2-dad4086b2e6f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.175652 Jul 28 18:06:11.296144 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 259/518] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:11 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:11.533077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a13cd0aa-07d7-4368-a0ca-a4ca06e1fb2a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:11.533077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a13cd0aa-07d7-4368-a0ca-a4ca06e1fb2a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:11.536850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a13cd0aa-07d7-4368-a0ca-a4ca06e1fb2a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:11.537493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a13cd0aa-07d7-4368-a0ca-a4ca06e1fb2a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:11.538472 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a13cd0aa-07d7-4368-a0ca-a4ca06e1fb2a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:11.538915 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a13cd0aa-07d7-4368-a0ca-a4ca06e1fb2a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:11.606242 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a13cd0aa-07d7-4368-a0ca-a4ca06e1fb2a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:11.618045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a13cd0aa-07d7-4368-a0ca-a4ca06e1fb2a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.092426 Jul 28 18:06:11.619045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 260/519] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:11 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:12.021467 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0d720488-007a-4544-9c05-06fd294f1409 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:12.024246 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0d720488-007a-4544-9c05-06fd294f1409 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:12.030565 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0d720488-007a-4544-9c05-06fd294f1409 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:12.031069 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0d720488-007a-4544-9c05-06fd294f1409 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:12.031875 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0d720488-007a-4544-9c05-06fd294f1409 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:12.033368 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0d720488-007a-4544-9c05-06fd294f1409 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:12.078468 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:12.251687 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0d720488-007a-4544-9c05-06fd294f1409 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "POST /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/action" status: 202 len: 0 microversion: 2.1 time: 0.231820 Jul 28 18:06:12.251687 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 260/520] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:06:12 2022] POST /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:06:12.259370 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-edda0b0c-5315-4678-89e0-0b9113bdc1c4 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:12.268450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-edda0b0c-5315-4678-89e0-0b9113bdc1c4 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:12.275699 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-edda0b0c-5315-4678-89e0-0b9113bdc1c4 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:12.276367 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-edda0b0c-5315-4678-89e0-0b9113bdc1c4 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:12.277351 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-edda0b0c-5315-4678-89e0-0b9113bdc1c4 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:12.278024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-edda0b0c-5315-4678-89e0-0b9113bdc1c4 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:12.320791 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6a22de96-6506-4b7c-838c-29b6d0b1e9ac tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:12.321520 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6a22de96-6506-4b7c-838c-29b6d0b1e9ac tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:12.325000 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=56 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:12.331681 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6a22de96-6506-4b7c-838c-29b6d0b1e9ac tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:12.332328 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6a22de96-6506-4b7c-838c-29b6d0b1e9ac tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:12.333286 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6a22de96-6506-4b7c-838c-29b6d0b1e9ac tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:12.333879 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6a22de96-6506-4b7c-838c-29b6d0b1e9ac tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:12.514995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-edda0b0c-5315-4678-89e0-0b9113bdc1c4 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:12.520317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6a22de96-6506-4b7c-838c-29b6d0b1e9ac tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:12.524870 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-edda0b0c-5315-4678-89e0-0b9113bdc1c4 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1751 microversion: 2.1 time: 0.269416 Jul 28 18:06:12.525850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 261/521] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:12 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1751 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:12.528082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6a22de96-6506-4b7c-838c-29b6d0b1e9ac tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.214627 Jul 28 18:06:12.528637 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 261/522] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:12 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:12.639996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fa487f9a-2a6b-4065-ade1-3863df85f7f5 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:12.640610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fa487f9a-2a6b-4065-ade1-3863df85f7f5 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:12.643766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:12.648677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fa487f9a-2a6b-4065-ade1-3863df85f7f5 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:12.649119 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fa487f9a-2a6b-4065-ade1-3863df85f7f5 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:12.649962 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fa487f9a-2a6b-4065-ade1-3863df85f7f5 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:12.650587 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fa487f9a-2a6b-4065-ade1-3863df85f7f5 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:12.715176 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fa487f9a-2a6b-4065-ade1-3863df85f7f5 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:12.722741 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fa487f9a-2a6b-4065-ade1-3863df85f7f5 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.086558 Jul 28 18:06:12.723309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 262/523] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:12 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:13.548482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0591ba53-c32f-4877-8c5e-5fcbbf4dcc24 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:13.549586 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0591ba53-c32f-4877-8c5e-5fcbbf4dcc24 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:13.549807 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f68d585c-03ed-4684-8c1a-d49c5efc3eed tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:13.550455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f68d585c-03ed-4684-8c1a-d49c5efc3eed tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:13.556831 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f68d585c-03ed-4684-8c1a-d49c5efc3eed tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:13.557492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f68d585c-03ed-4684-8c1a-d49c5efc3eed tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:13.558044 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0591ba53-c32f-4877-8c5e-5fcbbf4dcc24 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:13.558173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f68d585c-03ed-4684-8c1a-d49c5efc3eed tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:13.558594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f68d585c-03ed-4684-8c1a-d49c5efc3eed tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:13.558761 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0591ba53-c32f-4877-8c5e-5fcbbf4dcc24 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:13.559581 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0591ba53-c32f-4877-8c5e-5fcbbf4dcc24 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:13.560094 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0591ba53-c32f-4877-8c5e-5fcbbf4dcc24 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:13.722013 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f68d585c-03ed-4684-8c1a-d49c5efc3eed tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:13.734144 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f68d585c-03ed-4684-8c1a-d49c5efc3eed tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.188961 Jul 28 18:06:13.735434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 263/524] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:13 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:13.755403 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-432560d8-2e17-477a-951a-25c7087e5582 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:13.756264 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-432560d8-2e17-477a-951a-25c7087e5582 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:13.764222 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-432560d8-2e17-477a-951a-25c7087e5582 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:13.764913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-432560d8-2e17-477a-951a-25c7087e5582 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:13.765960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-432560d8-2e17-477a-951a-25c7087e5582 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:13.767401 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-432560d8-2e17-477a-951a-25c7087e5582 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:13.804004 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=10 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:13.838109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0591ba53-c32f-4877-8c5e-5fcbbf4dcc24 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:13.847815 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0591ba53-c32f-4877-8c5e-5fcbbf4dcc24 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1751 microversion: 2.1 time: 0.303357 Jul 28 18:06:13.848133 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 262/525] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:13 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1751 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:13.850316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-432560d8-2e17-477a-951a-25c7087e5582 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:13.858743 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-432560d8-2e17-477a-951a-25c7087e5582 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.107975 Jul 28 18:06:13.863408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 264/526] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:13 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:14.755664 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ad64b442-a06f-4cd3-a22f-7711f5fbb5da tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:14.756396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ad64b442-a06f-4cd3-a22f-7711f5fbb5da tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:14.763688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad64b442-a06f-4cd3-a22f-7711f5fbb5da tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:14.764443 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad64b442-a06f-4cd3-a22f-7711f5fbb5da tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:14.765689 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad64b442-a06f-4cd3-a22f-7711f5fbb5da tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:14.766424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad64b442-a06f-4cd3-a22f-7711f5fbb5da tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:14.870023 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e6c4fab7-10a2-4266-915d-bf4bd8acb008 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:14.873613 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e6c4fab7-10a2-4266-915d-bf4bd8acb008 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:14.887581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e6c4fab7-10a2-4266-915d-bf4bd8acb008 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:14.898947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e6c4fab7-10a2-4266-915d-bf4bd8acb008 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:14.900025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e6c4fab7-10a2-4266-915d-bf4bd8acb008 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:14.902436 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e6c4fab7-10a2-4266-915d-bf4bd8acb008 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:15.118641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ad64b442-a06f-4cd3-a22f-7711f5fbb5da tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:15.118873 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e6c4fab7-10a2-4266-915d-bf4bd8acb008 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:15.128843 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ad64b442-a06f-4cd3-a22f-7711f5fbb5da tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.377150 Jul 28 18:06:15.130271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 263/527] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:14 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:15.133662 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e6c4fab7-10a2-4266-915d-bf4bd8acb008 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1751 microversion: 2.1 time: 0.268202 Jul 28 18:06:15.135113 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-95fba458-d19b-46ec-9888-7ed49f0e9e68 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:15.135886 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-95fba458-d19b-46ec-9888-7ed49f0e9e68 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:15.136529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 265/528] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:14 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1751 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:15.144045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95fba458-d19b-46ec-9888-7ed49f0e9e68 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:15.144689 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95fba458-d19b-46ec-9888-7ed49f0e9e68 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:15.145972 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95fba458-d19b-46ec-9888-7ed49f0e9e68 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:15.146632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95fba458-d19b-46ec-9888-7ed49f0e9e68 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:15.240312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-95fba458-d19b-46ec-9888-7ed49f0e9e68 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:15.252152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-95fba458-d19b-46ec-9888-7ed49f0e9e68 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.120512 Jul 28 18:06:15.258598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 264/529] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:15 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:16.152960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3c4b0cd4-6a2b-4073-98d6-89fd9f537988 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:16.153565 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3c4b0cd4-6a2b-4073-98d6-89fd9f537988 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:16.156137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6e25db55-c415-45c5-b89e-0e51f9ea679e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:16.158735 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6e25db55-c415-45c5-b89e-0e51f9ea679e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:16.165518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3c4b0cd4-6a2b-4073-98d6-89fd9f537988 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:16.165639 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3c4b0cd4-6a2b-4073-98d6-89fd9f537988 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:16.166203 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6e25db55-c415-45c5-b89e-0e51f9ea679e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:16.166656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3c4b0cd4-6a2b-4073-98d6-89fd9f537988 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:16.166774 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6e25db55-c415-45c5-b89e-0e51f9ea679e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:16.167161 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3c4b0cd4-6a2b-4073-98d6-89fd9f537988 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:16.167768 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6e25db55-c415-45c5-b89e-0e51f9ea679e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:16.168268 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6e25db55-c415-45c5-b89e-0e51f9ea679e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:16.400583 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3c4b0cd4-6a2b-4073-98d6-89fd9f537988 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:16.409149 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3c4b0cd4-6a2b-4073-98d6-89fd9f537988 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.260075 Jul 28 18:06:16.409665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 266/530] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:16 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:16.415424 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-500c7303-8db4-4990-9a4f-471184c7837a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:16.416197 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-500c7303-8db4-4990-9a4f-471184c7837a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:16.422114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-500c7303-8db4-4990-9a4f-471184c7837a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:16.423134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-500c7303-8db4-4990-9a4f-471184c7837a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:16.423908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-500c7303-8db4-4990-9a4f-471184c7837a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:16.424342 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-500c7303-8db4-4990-9a4f-471184c7837a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:16.428750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:16.466772 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6e25db55-c415-45c5-b89e-0e51f9ea679e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:16.476828 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6e25db55-c415-45c5-b89e-0e51f9ea679e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1751 microversion: 2.1 time: 0.325317 Jul 28 18:06:16.477789 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 265/531] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:16 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1751 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:16.490732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-500c7303-8db4-4990-9a4f-471184c7837a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:16.498401 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-500c7303-8db4-4990-9a4f-471184c7837a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.087481 Jul 28 18:06:16.499061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 267/532] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:16 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:17.429305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6deec85f-70ae-4b75-8653-d71952fb9c59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:17.431166 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6deec85f-70ae-4b75-8653-d71952fb9c59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:17.442462 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6deec85f-70ae-4b75-8653-d71952fb9c59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:17.444465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6deec85f-70ae-4b75-8653-d71952fb9c59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:17.445370 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6deec85f-70ae-4b75-8653-d71952fb9c59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:17.451180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6deec85f-70ae-4b75-8653-d71952fb9c59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:17.499428 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-18da219b-94b7-4313-8134-99a28c6fe326 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:17.501386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-18da219b-94b7-4313-8134-99a28c6fe326 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:17.509971 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-18da219b-94b7-4313-8134-99a28c6fe326 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:17.510912 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-18da219b-94b7-4313-8134-99a28c6fe326 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:17.511982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-18da219b-94b7-4313-8134-99a28c6fe326 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:17.512585 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-18da219b-94b7-4313-8134-99a28c6fe326 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:17.742559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6deec85f-70ae-4b75-8653-d71952fb9c59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:17.744616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-18da219b-94b7-4313-8134-99a28c6fe326 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:17.753125 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6deec85f-70ae-4b75-8653-d71952fb9c59 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.324876 Jul 28 18:06:17.758633 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-18da219b-94b7-4313-8134-99a28c6fe326 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1751 microversion: 2.1 time: 0.263056 Jul 28 18:06:17.761536 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 268/533] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:17 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:17.767132 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 266/534] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:17 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:17.769743 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e8eba5e6-6d5b-4258-a218-859d7baf40fd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:17.770624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e8eba5e6-6d5b-4258-a218-859d7baf40fd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:17.778643 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e8eba5e6-6d5b-4258-a218-859d7baf40fd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:17.779231 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e8eba5e6-6d5b-4258-a218-859d7baf40fd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:17.780109 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e8eba5e6-6d5b-4258-a218-859d7baf40fd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:17.780608 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e8eba5e6-6d5b-4258-a218-859d7baf40fd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:17.862661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e8eba5e6-6d5b-4258-a218-859d7baf40fd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:17.870644 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e8eba5e6-6d5b-4258-a218-859d7baf40fd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.107198 Jul 28 18:06:17.871735 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 269/535] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:17 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:18.775195 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6a234d77-b725-4e57-aa2c-e3c6de1bb3d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:18.775959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6a234d77-b725-4e57-aa2c-e3c6de1bb3d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:18.781548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-25c0657a-6491-4906-9357-cba1fd4c3d87 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:18.782323 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-25c0657a-6491-4906-9357-cba1fd4c3d87 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:18.783013 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6a234d77-b725-4e57-aa2c-e3c6de1bb3d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:18.783577 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6a234d77-b725-4e57-aa2c-e3c6de1bb3d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:18.784451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6a234d77-b725-4e57-aa2c-e3c6de1bb3d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:18.784992 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6a234d77-b725-4e57-aa2c-e3c6de1bb3d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:18.789283 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-25c0657a-6491-4906-9357-cba1fd4c3d87 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:18.789661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-25c0657a-6491-4906-9357-cba1fd4c3d87 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:18.790896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-25c0657a-6491-4906-9357-cba1fd4c3d87 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:18.791256 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-25c0657a-6491-4906-9357-cba1fd4c3d87 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:18.963985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-25c0657a-6491-4906-9357-cba1fd4c3d87 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:18.978423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-25c0657a-6491-4906-9357-cba1fd4c3d87 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1751 microversion: 2.1 time: 0.200855 Jul 28 18:06:18.980723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 270/536] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:18 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:18.988092 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8ea1e703-d875-4492-96f2-a0a1c03c38dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:18.990170 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8ea1e703-d875-4492-96f2-a0a1c03c38dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:19.007531 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ea1e703-d875-4492-96f2-a0a1c03c38dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:19.007980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ea1e703-d875-4492-96f2-a0a1c03c38dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:19.008753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ea1e703-d875-4492-96f2-a0a1c03c38dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:19.010668 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ea1e703-d875-4492-96f2-a0a1c03c38dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:19.082659 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8ea1e703-d875-4492-96f2-a0a1c03c38dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:19.091457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8ea1e703-d875-4492-96f2-a0a1c03c38dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.108507 Jul 28 18:06:19.091457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 271/537] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:18 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:19.096851 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6a234d77-b725-4e57-aa2c-e3c6de1bb3d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:19.106562 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6a234d77-b725-4e57-aa2c-e3c6de1bb3d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.335306 Jul 28 18:06:19.107358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 267/538] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:18 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:19.716293 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f35e5905-12c3-4b90-8c6d-3e97b546f86a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Action: 'create', calling method: .version_select at 0x7fdae046fa60>, body: {"keypair": {"name": "tempest-TestShelveInstance-673230153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOgAJQu9wW/ecQn+lKjsj0cCg+IWxg6BIIVBfw3F5rpCxXr8YPVlv3qTv5Sw3pA0awNMcMr/fm+PcXPD5UAVhnXoFWOtnWCeH/KbSQ3CSoKXHRuDcIYMKqNvMVn7s8M3g=="}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:19.732196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-f35e5905-12c3-4b90-8c6d-3e97b546f86a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Getting quotas for project efa7968cb99d4470b48f8ff2fd8bad7a. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:06:19.737596 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-f35e5905-12c3-4b90-8c6d-3e97b546f86a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Getting quotas for user 186ea84ee37d48c186190438adce39b9 and project efa7968cb99d4470b48f8ff2fd8bad7a. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:06:19.813931 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f35e5905-12c3-4b90-8c6d-3e97b546f86a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.277946 Jul 28 18:06:19.815852 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 272/539] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:06:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:20.007546 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-957abc94-e922-49b3-9d20-8c5842bd1275 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:20.008989 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-957abc94-e922-49b3-9d20-8c5842bd1275 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:20.016263 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-957abc94-e922-49b3-9d20-8c5842bd1275 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:20.016737 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-957abc94-e922-49b3-9d20-8c5842bd1275 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:20.017528 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-957abc94-e922-49b3-9d20-8c5842bd1275 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:20.017999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-957abc94-e922-49b3-9d20-8c5842bd1275 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:20.113255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fcfd8011-797a-4766-b161-0e75d1a4d84f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:20.114071 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fcfd8011-797a-4766-b161-0e75d1a4d84f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:20.121686 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fcfd8011-797a-4766-b161-0e75d1a4d84f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:20.122647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fcfd8011-797a-4766-b161-0e75d1a4d84f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:20.128063 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fcfd8011-797a-4766-b161-0e75d1a4d84f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:20.128063 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fcfd8011-797a-4766-b161-0e75d1a4d84f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:20.199455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fcfd8011-797a-4766-b161-0e75d1a4d84f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:20.208587 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fcfd8011-797a-4766-b161-0e75d1a4d84f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.100268 Jul 28 18:06:20.214398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 273/540] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:20 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:20.214691 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-957abc94-e922-49b3-9d20-8c5842bd1275 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:20.222629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ce920990-8374-428d-9669-ce688facbccc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:20.223736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ce920990-8374-428d-9669-ce688facbccc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:20.225039 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-957abc94-e922-49b3-9d20-8c5842bd1275 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1751 microversion: 2.1 time: 0.221086 Jul 28 18:06:20.225683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 268/541] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:20 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:20.230600 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce920990-8374-428d-9669-ce688facbccc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:20.231113 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce920990-8374-428d-9669-ce688facbccc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:20.231948 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce920990-8374-428d-9669-ce688facbccc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:20.232710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce920990-8374-428d-9669-ce688facbccc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:20.402068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ce920990-8374-428d-9669-ce688facbccc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:20.410737 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ce920990-8374-428d-9669-ce688facbccc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.199221 Jul 28 18:06:20.411629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 274/542] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:20 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:21.229910 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cd8cf609-29c8-4e9f-a9c0-87a1c2df3f31 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:21.231004 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cd8cf609-29c8-4e9f-a9c0-87a1c2df3f31 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:21.240736 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd8cf609-29c8-4e9f-a9c0-87a1c2df3f31 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:21.241192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd8cf609-29c8-4e9f-a9c0-87a1c2df3f31 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:21.242767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd8cf609-29c8-4e9f-a9c0-87a1c2df3f31 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:21.243274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd8cf609-29c8-4e9f-a9c0-87a1c2df3f31 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:21.247576 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-27575e1b-7b0e-4622-bfa3-f187ac2ed60a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:21.248264 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-27575e1b-7b0e-4622-bfa3-f187ac2ed60a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:21.257685 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-27575e1b-7b0e-4622-bfa3-f187ac2ed60a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:21.260491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-27575e1b-7b0e-4622-bfa3-f187ac2ed60a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:21.260617 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-27575e1b-7b0e-4622-bfa3-f187ac2ed60a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:21.261340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-27575e1b-7b0e-4622-bfa3-f187ac2ed60a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:21.318573 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-cd8cf609-29c8-4e9f-a9c0-87a1c2df3f31 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:21.326542 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cd8cf609-29c8-4e9f-a9c0-87a1c2df3f31 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1223 microversion: 2.1 time: 0.101183 Jul 28 18:06:21.327113 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 269/543] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:21 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:21.433101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-376a1254-86cc-44bf-af94-b71cef4dded1 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:21.434041 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-376a1254-86cc-44bf-af94-b71cef4dded1 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:21.441260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-376a1254-86cc-44bf-af94-b71cef4dded1 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:21.441782 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-376a1254-86cc-44bf-af94-b71cef4dded1 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:21.442668 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-376a1254-86cc-44bf-af94-b71cef4dded1 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:21.443265 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-376a1254-86cc-44bf-af94-b71cef4dded1 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:21.495001 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-27575e1b-7b0e-4622-bfa3-f187ac2ed60a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:21.504493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-27575e1b-7b0e-4622-bfa3-f187ac2ed60a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1751 microversion: 2.1 time: 0.261205 Jul 28 18:06:21.505151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 275/544] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:21 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:21.581312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-376a1254-86cc-44bf-af94-b71cef4dded1 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:21.589657 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-376a1254-86cc-44bf-af94-b71cef4dded1 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.160442 Jul 28 18:06:21.590244 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 270/545] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:21 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:22.418808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2d5e80c1-d655-4e69-b2d7-865d6b14f966 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:22.419413 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2d5e80c1-d655-4e69-b2d7-865d6b14f966 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:22.426970 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2d5e80c1-d655-4e69-b2d7-865d6b14f966 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:22.427420 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2d5e80c1-d655-4e69-b2d7-865d6b14f966 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:22.428189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2d5e80c1-d655-4e69-b2d7-865d6b14f966 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:22.428628 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2d5e80c1-d655-4e69-b2d7-865d6b14f966 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:22.500852 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2d5e80c1-d655-4e69-b2d7-865d6b14f966 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:22.508642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2d5e80c1-d655-4e69-b2d7-865d6b14f966 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1271 microversion: 2.1 time: 0.093684 Jul 28 18:06:22.509221 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 276/546] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:22 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:22.536633 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e5c04d43-a3ce-4d52-97c5-8b5cf51db59b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:22.537241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e5c04d43-a3ce-4d52-97c5-8b5cf51db59b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:22.544444 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5c04d43-a3ce-4d52-97c5-8b5cf51db59b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:22.545182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5c04d43-a3ce-4d52-97c5-8b5cf51db59b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:22.547779 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5c04d43-a3ce-4d52-97c5-8b5cf51db59b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:22.548713 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5c04d43-a3ce-4d52-97c5-8b5cf51db59b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:22.615524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3161a85f-cb5c-4972-aa50-6b073676802d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:22.616523 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3161a85f-cb5c-4972-aa50-6b073676802d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:22.624914 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3161a85f-cb5c-4972-aa50-6b073676802d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:22.627126 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3161a85f-cb5c-4972-aa50-6b073676802d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:22.628204 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3161a85f-cb5c-4972-aa50-6b073676802d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:22.628810 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3161a85f-cb5c-4972-aa50-6b073676802d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:22.753506 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e5c04d43-a3ce-4d52-97c5-8b5cf51db59b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:22.761990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e5c04d43-a3ce-4d52-97c5-8b5cf51db59b tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.229403 Jul 28 18:06:22.762886 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 271/547] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:22 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:22.803008 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3161a85f-cb5c-4972-aa50-6b073676802d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:22.812488 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3161a85f-cb5c-4972-aa50-6b073676802d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.205171 Jul 28 18:06:22.813980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 277/548] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:22 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:23.529934 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2364b59d-69a9-46d9-8166-74f4ca0ab9e1 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:23.530579 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2364b59d-69a9-46d9-8166-74f4ca0ab9e1 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:23.537033 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2364b59d-69a9-46d9-8166-74f4ca0ab9e1 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:23.537695 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2364b59d-69a9-46d9-8166-74f4ca0ab9e1 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:23.538516 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2364b59d-69a9-46d9-8166-74f4ca0ab9e1 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:23.539561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2364b59d-69a9-46d9-8166-74f4ca0ab9e1 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:23.639381 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2364b59d-69a9-46d9-8166-74f4ca0ab9e1 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:23.663399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2364b59d-69a9-46d9-8166-74f4ca0ab9e1 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1277 microversion: 2.1 time: 0.136222 Jul 28 18:06:23.666285 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 272/549] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:23 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:23.786569 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4ca192bc-dbcf-4963-9854-8e61e3eef435 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:23.787361 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4ca192bc-dbcf-4963-9854-8e61e3eef435 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:23.794620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ca192bc-dbcf-4963-9854-8e61e3eef435 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:23.795183 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ca192bc-dbcf-4963-9854-8e61e3eef435 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:23.796085 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ca192bc-dbcf-4963-9854-8e61e3eef435 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:23.796726 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ca192bc-dbcf-4963-9854-8e61e3eef435 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:23.815029 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9d1f17a6-40fb-4c9d-930f-cffdc5c772f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:23.818301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9d1f17a6-40fb-4c9d-930f-cffdc5c772f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:23.825221 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9d1f17a6-40fb-4c9d-930f-cffdc5c772f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:23.825896 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9d1f17a6-40fb-4c9d-930f-cffdc5c772f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:23.826970 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9d1f17a6-40fb-4c9d-930f-cffdc5c772f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:23.827558 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9d1f17a6-40fb-4c9d-930f-cffdc5c772f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:23.861474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-9d1f17a6-40fb-4c9d-930f-cffdc5c772f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'flavor' on Instance uuid 07dd071c-f443-4fbc-a37c-0b8b250968a4 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:06:24.011751 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ca192bc-dbcf-4963-9854-8e61e3eef435 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:24.025084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4ca192bc-dbcf-4963-9854-8e61e3eef435 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.242023 Jul 28 18:06:24.039484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 278/550] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:23 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:24.047700 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1806b47a-fdf1-46c2-a55e-61c24d2178d0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:24.053906 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1806b47a-fdf1-46c2-a55e-61c24d2178d0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:24.056111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1806b47a-fdf1-46c2-a55e-61c24d2178d0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:24.056822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1806b47a-fdf1-46c2-a55e-61c24d2178d0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:24.057994 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1806b47a-fdf1-46c2-a55e-61c24d2178d0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:24.058655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1806b47a-fdf1-46c2-a55e-61c24d2178d0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:24.256031 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1806b47a-fdf1-46c2-a55e-61c24d2178d0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:24.267708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1806b47a-fdf1-46c2-a55e-61c24d2178d0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1279 microversion: 2.1 time: 0.226579 Jul 28 18:06:24.268417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 279/551] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:24 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:24.691279 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cf60c64c-a781-4628-80af-32169ab703ed tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:24.692010 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cf60c64c-a781-4628-80af-32169ab703ed tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:24.698559 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cf60c64c-a781-4628-80af-32169ab703ed tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:24.700933 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cf60c64c-a781-4628-80af-32169ab703ed tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:24.702037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cf60c64c-a781-4628-80af-32169ab703ed tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:24.702698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cf60c64c-a781-4628-80af-32169ab703ed tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:24.877550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cf60c64c-a781-4628-80af-32169ab703ed tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:24.901577 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cf60c64c-a781-4628-80af-32169ab703ed tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.215486 Jul 28 18:06:24.901740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9d1f17a6-40fb-4c9d-930f-cffdc5c772f9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/action" status: 200 len: 32 microversion: 2.1 time: 1.090965 Jul 28 18:06:24.902473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 273/552] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:06:23 2022] POST /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/action => generated 32 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 18:06:24.912705 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 280/553] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:24 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:24.926401 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-250aa6be-e54a-4f94-9944-2f0d7364c011 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:24.927140 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-250aa6be-e54a-4f94-9944-2f0d7364c011 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:24.934606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-250aa6be-e54a-4f94-9944-2f0d7364c011 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:24.935169 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-250aa6be-e54a-4f94-9944-2f0d7364c011 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:24.935977 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-250aa6be-e54a-4f94-9944-2f0d7364c011 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:24.936686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-250aa6be-e54a-4f94-9944-2f0d7364c011 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:24.957516 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:25.067609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5d292494-cbdd-4a81-a5b2-1a2fdaa0ccaa tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:25.068243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5d292494-cbdd-4a81-a5b2-1a2fdaa0ccaa tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:25.077096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5d292494-cbdd-4a81-a5b2-1a2fdaa0ccaa tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:25.077894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5d292494-cbdd-4a81-a5b2-1a2fdaa0ccaa tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:25.079282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5d292494-cbdd-4a81-a5b2-1a2fdaa0ccaa tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:25.079865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5d292494-cbdd-4a81-a5b2-1a2fdaa0ccaa tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:25.170703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-250aa6be-e54a-4f94-9944-2f0d7364c011 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:25.182037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-250aa6be-e54a-4f94-9944-2f0d7364c011 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.272768 Jul 28 18:06:25.182903 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 274/554] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:24 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:25.297686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cb7fd2fc-dff8-462d-ac3e-845921d6600f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:25.298651 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cb7fd2fc-dff8-462d-ac3e-845921d6600f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:25.306765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cb7fd2fc-dff8-462d-ac3e-845921d6600f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:25.307518 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cb7fd2fc-dff8-462d-ac3e-845921d6600f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:25.308987 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cb7fd2fc-dff8-462d-ac3e-845921d6600f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:25.309586 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cb7fd2fc-dff8-462d-ac3e-845921d6600f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:25.347131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5d292494-cbdd-4a81-a5b2-1a2fdaa0ccaa tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:25.359136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5d292494-cbdd-4a81-a5b2-1a2fdaa0ccaa tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.311013 Jul 28 18:06:25.376772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 281/555] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:25 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:25.545748 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-cb7fd2fc-dff8-462d-ac3e-845921d6600f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:25.556138 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cb7fd2fc-dff8-462d-ac3e-845921d6600f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.262961 Jul 28 18:06:25.556717 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 275/556] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:25 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:25.666550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-30851f4a-91b0-49e1-9a13-72dc9735b79b req-131522e6-c8a0-47e9-bda1-66c5a15ea802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb343d5-d21e-4542-a9b9-699415dbbb36", "tag": "fe531d4b-eb49-4238-84c1-95c99ca13d2c"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:25.686162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-30851f4a-91b0-49e1-9a13-72dc9735b79b req-131522e6-c8a0-47e9-bda1-66c5a15ea802 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:25.686998 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-30851f4a-91b0-49e1-9a13-72dc9735b79b req-131522e6-c8a0-47e9-bda1-66c5a15ea802 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:25.702069 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-30851f4a-91b0-49e1-9a13-72dc9735b79b req-131522e6-c8a0-47e9-bda1-66c5a15ea802 service nova] Creating event network-changed:fe531d4b-eb49-4238-84c1-95c99ca13d2c for instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 on hv-cinder-83754 Jul 28 18:06:25.709054 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-30851f4a-91b0-49e1-9a13-72dc9735b79b req-131522e6-c8a0-47e9-bda1-66c5a15ea802 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050008 Jul 28 18:06:25.710297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 282/557] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:25.937158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8043df02-01c2-4155-b1b2-11704bde3357 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:25.939359 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8043df02-01c2-4155-b1b2-11704bde3357 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:25.946455 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8043df02-01c2-4155-b1b2-11704bde3357 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:25.946865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8043df02-01c2-4155-b1b2-11704bde3357 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:25.947641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8043df02-01c2-4155-b1b2-11704bde3357 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:25.948152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8043df02-01c2-4155-b1b2-11704bde3357 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:26.179141 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8043df02-01c2-4155-b1b2-11704bde3357 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:26.186649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8043df02-01c2-4155-b1b2-11704bde3357 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.257488 Jul 28 18:06:26.187213 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 276/558] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:25 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:26.206122 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cd95f607-3182-4af5-8659-efb0079eb866 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:26.206897 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cd95f607-3182-4af5-8659-efb0079eb866 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:26.213647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd95f607-3182-4af5-8659-efb0079eb866 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:26.219322 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd95f607-3182-4af5-8659-efb0079eb866 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:26.219322 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd95f607-3182-4af5-8659-efb0079eb866 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:26.219322 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd95f607-3182-4af5-8659-efb0079eb866 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:26.384463 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-64ba2203-5942-49a9-a23c-30279815c1c7 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:26.388004 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-64ba2203-5942-49a9-a23c-30279815c1c7 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:26.393457 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64ba2203-5942-49a9-a23c-30279815c1c7 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:26.394287 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64ba2203-5942-49a9-a23c-30279815c1c7 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:26.395325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64ba2203-5942-49a9-a23c-30279815c1c7 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:26.395982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64ba2203-5942-49a9-a23c-30279815c1c7 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:26.416475 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cd95f607-3182-4af5-8659-efb0079eb866 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:26.431621 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cd95f607-3182-4af5-8659-efb0079eb866 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.230734 Jul 28 18:06:26.432205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 283/559] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:26 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:26.596909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f3c47d99-5fa0-4a3e-9ed6-c8ead99e7d1c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:26.596909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f3c47d99-5fa0-4a3e-9ed6-c8ead99e7d1c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:26.603022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f3c47d99-5fa0-4a3e-9ed6-c8ead99e7d1c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:26.603604 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f3c47d99-5fa0-4a3e-9ed6-c8ead99e7d1c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:26.604572 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f3c47d99-5fa0-4a3e-9ed6-c8ead99e7d1c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:26.605334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f3c47d99-5fa0-4a3e-9ed6-c8ead99e7d1c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:26.659390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-64ba2203-5942-49a9-a23c-30279815c1c7 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:26.667990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-64ba2203-5942-49a9-a23c-30279815c1c7 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.288416 Jul 28 18:06:26.668874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 277/560] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:26 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:26.823084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f3c47d99-5fa0-4a3e-9ed6-c8ead99e7d1c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:26.834552 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f3c47d99-5fa0-4a3e-9ed6-c8ead99e7d1c tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.247698 Jul 28 18:06:26.835519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 284/561] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:26 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:27.208819 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bf3fd44d-e708-4828-99cb-cf7b409dabd2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:27.210028 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bf3fd44d-e708-4828-99cb-cf7b409dabd2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:27.220538 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf3fd44d-e708-4828-99cb-cf7b409dabd2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:27.220976 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf3fd44d-e708-4828-99cb-cf7b409dabd2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:27.221784 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf3fd44d-e708-4828-99cb-cf7b409dabd2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:27.222448 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf3fd44d-e708-4828-99cb-cf7b409dabd2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:27.373451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bf3fd44d-e708-4828-99cb-cf7b409dabd2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:27.382630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bf3fd44d-e708-4828-99cb-cf7b409dabd2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.177425 Jul 28 18:06:27.383220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 278/562] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:27 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:27.459290 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-69bf55d5-9a01-4ec8-9dc6-105b1e16deb3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:27.459937 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-69bf55d5-9a01-4ec8-9dc6-105b1e16deb3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:27.462151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:27.471593 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69bf55d5-9a01-4ec8-9dc6-105b1e16deb3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:27.476997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69bf55d5-9a01-4ec8-9dc6-105b1e16deb3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:27.476997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69bf55d5-9a01-4ec8-9dc6-105b1e16deb3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:27.476997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69bf55d5-9a01-4ec8-9dc6-105b1e16deb3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:27.497047 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:27.619928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-69bf55d5-9a01-4ec8-9dc6-105b1e16deb3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:27.629018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-69bf55d5-9a01-4ec8-9dc6-105b1e16deb3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.177571 Jul 28 18:06:27.629646 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 285/563] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:27 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:27.690671 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bde0407b-1adc-4581-b271-7834e15dfced tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:27.691272 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bde0407b-1adc-4581-b271-7834e15dfced tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:27.697625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bde0407b-1adc-4581-b271-7834e15dfced tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:27.698063 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bde0407b-1adc-4581-b271-7834e15dfced tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:27.698860 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bde0407b-1adc-4581-b271-7834e15dfced tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:27.699300 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bde0407b-1adc-4581-b271-7834e15dfced tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:27.851471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bde0407b-1adc-4581-b271-7834e15dfced tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:27.854825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0b20ef06-cb07-4ea1-af2b-0bec9b964a54 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:27.855441 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0b20ef06-cb07-4ea1-af2b-0bec9b964a54 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:27.859987 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bde0407b-1adc-4581-b271-7834e15dfced tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.173815 Jul 28 18:06:27.860545 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 279/564] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:27 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:27.862129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0b20ef06-cb07-4ea1-af2b-0bec9b964a54 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:27.862609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0b20ef06-cb07-4ea1-af2b-0bec9b964a54 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:27.863383 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0b20ef06-cb07-4ea1-af2b-0bec9b964a54 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:27.863821 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0b20ef06-cb07-4ea1-af2b-0bec9b964a54 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:28.003316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0b20ef06-cb07-4ea1-af2b-0bec9b964a54 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:28.010742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0b20ef06-cb07-4ea1-af2b-0bec9b964a54 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.159707 Jul 28 18:06:28.011293 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 286/565] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:27 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:28.407959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-998d4ca8-d039-47b8-a8e8-5d32f4140ddd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:28.408544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-998d4ca8-d039-47b8-a8e8-5d32f4140ddd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:28.414536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-998d4ca8-d039-47b8-a8e8-5d32f4140ddd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:28.414983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-998d4ca8-d039-47b8-a8e8-5d32f4140ddd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:28.415740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-998d4ca8-d039-47b8-a8e8-5d32f4140ddd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:28.416178 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-998d4ca8-d039-47b8-a8e8-5d32f4140ddd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:28.549700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-998d4ca8-d039-47b8-a8e8-5d32f4140ddd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:28.557166 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-998d4ca8-d039-47b8-a8e8-5d32f4140ddd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.153673 Jul 28 18:06:28.562718 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 280/566] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:28 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:28.651244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5240685a-4010-4e11-ba7d-b8289d71577c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:28.651882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5240685a-4010-4e11-ba7d-b8289d71577c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:28.659532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5240685a-4010-4e11-ba7d-b8289d71577c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:28.659982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5240685a-4010-4e11-ba7d-b8289d71577c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:28.660775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5240685a-4010-4e11-ba7d-b8289d71577c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:28.661186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5240685a-4010-4e11-ba7d-b8289d71577c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:28.799513 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5240685a-4010-4e11-ba7d-b8289d71577c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:28.807455 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5240685a-4010-4e11-ba7d-b8289d71577c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.160286 Jul 28 18:06:28.808012 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 287/567] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:28 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:28.882370 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e5b09a22-5785-45e9-b81f-5a26198e7bde tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:28.883373 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e5b09a22-5785-45e9-b81f-5a26198e7bde tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:28.890368 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5b09a22-5785-45e9-b81f-5a26198e7bde tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:28.890998 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5b09a22-5785-45e9-b81f-5a26198e7bde tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:28.891960 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5b09a22-5785-45e9-b81f-5a26198e7bde tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:28.892403 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5b09a22-5785-45e9-b81f-5a26198e7bde tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:29.033214 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4ddcfa87-edb4-4279-9f69-c9c46499744f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:29.033832 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4ddcfa87-edb4-4279-9f69-c9c46499744f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:29.036326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e5b09a22-5785-45e9-b81f-5a26198e7bde tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:29.040219 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ddcfa87-edb4-4279-9f69-c9c46499744f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:29.040668 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ddcfa87-edb4-4279-9f69-c9c46499744f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:29.041442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ddcfa87-edb4-4279-9f69-c9c46499744f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:29.041876 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ddcfa87-edb4-4279-9f69-c9c46499744f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:29.048204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e5b09a22-5785-45e9-b81f-5a26198e7bde tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.167998 Jul 28 18:06:29.048767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 281/568] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:28 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:29.178086 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ddcfa87-edb4-4279-9f69-c9c46499744f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:29.185549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4ddcfa87-edb4-4279-9f69-c9c46499744f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.157367 Jul 28 18:06:29.186109 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 288/569] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:29 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:29.579506 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ab517016-6269-40af-b82c-4c7de6d06fa4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:29.580116 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ab517016-6269-40af-b82c-4c7de6d06fa4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:29.586266 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab517016-6269-40af-b82c-4c7de6d06fa4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:29.586732 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab517016-6269-40af-b82c-4c7de6d06fa4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:29.587495 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab517016-6269-40af-b82c-4c7de6d06fa4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:29.587922 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab517016-6269-40af-b82c-4c7de6d06fa4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:29.722425 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ab517016-6269-40af-b82c-4c7de6d06fa4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:29.730473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ab517016-6269-40af-b82c-4c7de6d06fa4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.155881 Jul 28 18:06:29.731043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 282/570] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:29 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:29.830109 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-081e8da8-cb76-4768-9eba-77786a403048 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:29.830764 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-081e8da8-cb76-4768-9eba-77786a403048 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:29.833760 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=4 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:29.842588 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-081e8da8-cb76-4768-9eba-77786a403048 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:29.848724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-081e8da8-cb76-4768-9eba-77786a403048 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:29.848724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-081e8da8-cb76-4768-9eba-77786a403048 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:29.848724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-081e8da8-cb76-4768-9eba-77786a403048 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:29.996952 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-081e8da8-cb76-4768-9eba-77786a403048 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:30.007708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-081e8da8-cb76-4768-9eba-77786a403048 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.182486 Jul 28 18:06:30.008289 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 289/571] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:29 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:30.070131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-12669dc8-5ab4-4862-ada7-601e9db0241e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:30.070775 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-12669dc8-5ab4-4862-ada7-601e9db0241e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:30.077307 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12669dc8-5ab4-4862-ada7-601e9db0241e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:30.077778 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12669dc8-5ab4-4862-ada7-601e9db0241e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:30.078661 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12669dc8-5ab4-4862-ada7-601e9db0241e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:30.079101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-12669dc8-5ab4-4862-ada7-601e9db0241e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:30.205317 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d0c9b95f-b133-4b35-8065-91397db245ce tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:30.205951 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d0c9b95f-b133-4b35-8065-91397db245ce tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:30.212984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d0c9b95f-b133-4b35-8065-91397db245ce tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:30.213549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d0c9b95f-b133-4b35-8065-91397db245ce tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:30.214431 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d0c9b95f-b133-4b35-8065-91397db245ce tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:30.215276 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d0c9b95f-b133-4b35-8065-91397db245ce tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:30.224163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-12669dc8-5ab4-4862-ada7-601e9db0241e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:30.235365 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-12669dc8-5ab4-4862-ada7-601e9db0241e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.168033 Jul 28 18:06:30.236719 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 283/572] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:30 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:30.355295 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d0c9b95f-b133-4b35-8065-91397db245ce tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:30.363974 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d0c9b95f-b133-4b35-8065-91397db245ce tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.162798 Jul 28 18:06:30.364532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 290/573] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:30 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:30.752099 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e859c52e-1d55-4fbe-a2e1-ecb0574b1416 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:30.752713 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e859c52e-1d55-4fbe-a2e1-ecb0574b1416 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:30.759164 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e859c52e-1d55-4fbe-a2e1-ecb0574b1416 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:30.759569 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e859c52e-1d55-4fbe-a2e1-ecb0574b1416 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:30.760336 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e859c52e-1d55-4fbe-a2e1-ecb0574b1416 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:30.760787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e859c52e-1d55-4fbe-a2e1-ecb0574b1416 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:30.909493 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e859c52e-1d55-4fbe-a2e1-ecb0574b1416 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:30.917101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e859c52e-1d55-4fbe-a2e1-ecb0574b1416 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.168863 Jul 28 18:06:30.917781 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 284/574] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:30 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:31.029362 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bd4738ba-d134-40a3-a6db-890f1f0288ab tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:31.029903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bd4738ba-d134-40a3-a6db-890f1f0288ab tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:31.037717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bd4738ba-d134-40a3-a6db-890f1f0288ab tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:31.038174 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bd4738ba-d134-40a3-a6db-890f1f0288ab tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:31.038993 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bd4738ba-d134-40a3-a6db-890f1f0288ab tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:31.039436 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bd4738ba-d134-40a3-a6db-890f1f0288ab tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:31.177935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bd4738ba-d134-40a3-a6db-890f1f0288ab tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:31.186007 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bd4738ba-d134-40a3-a6db-890f1f0288ab tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.160660 Jul 28 18:06:31.186604 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 291/575] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:31 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:31.257894 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0dda03f0-4fb1-4d09-adcd-714f288193c5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:31.258554 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0dda03f0-4fb1-4d09-adcd-714f288193c5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:31.265183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0dda03f0-4fb1-4d09-adcd-714f288193c5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:31.266329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0dda03f0-4fb1-4d09-adcd-714f288193c5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:31.266766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0dda03f0-4fb1-4d09-adcd-714f288193c5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:31.267892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0dda03f0-4fb1-4d09-adcd-714f288193c5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:31.385318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b52ac28d-8bb8-4a87-a2c3-a3febdcd33e9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:31.386035 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b52ac28d-8bb8-4a87-a2c3-a3febdcd33e9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:31.392737 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b52ac28d-8bb8-4a87-a2c3-a3febdcd33e9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:31.393271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b52ac28d-8bb8-4a87-a2c3-a3febdcd33e9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:31.394114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b52ac28d-8bb8-4a87-a2c3-a3febdcd33e9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:31.394659 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b52ac28d-8bb8-4a87-a2c3-a3febdcd33e9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:31.419291 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0dda03f0-4fb1-4d09-adcd-714f288193c5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:31.427803 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0dda03f0-4fb1-4d09-adcd-714f288193c5 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.174057 Jul 28 18:06:31.428364 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 285/576] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:31 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:31.534899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b52ac28d-8bb8-4a87-a2c3-a3febdcd33e9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:31.547615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b52ac28d-8bb8-4a87-a2c3-a3febdcd33e9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.161332 Jul 28 18:06:31.547615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 292/577] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:31 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:31.938180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-28c17b0f-2f6d-4898-aa2d-5ece51bbc236 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:31.938827 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-28c17b0f-2f6d-4898-aa2d-5ece51bbc236 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:31.944804 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28c17b0f-2f6d-4898-aa2d-5ece51bbc236 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:31.945245 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28c17b0f-2f6d-4898-aa2d-5ece51bbc236 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:31.946000 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28c17b0f-2f6d-4898-aa2d-5ece51bbc236 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:31.946461 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28c17b0f-2f6d-4898-aa2d-5ece51bbc236 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:32.083896 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-28c17b0f-2f6d-4898-aa2d-5ece51bbc236 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:32.091381 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-28c17b0f-2f6d-4898-aa2d-5ece51bbc236 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.157152 Jul 28 18:06:32.103282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 286/578] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:31 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:32.208119 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b88947e2-6003-4050-8a61-44b250004627 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:32.208732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b88947e2-6003-4050-8a61-44b250004627 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:32.216097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b88947e2-6003-4050-8a61-44b250004627 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:32.216588 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b88947e2-6003-4050-8a61-44b250004627 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:32.217522 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b88947e2-6003-4050-8a61-44b250004627 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:32.218022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b88947e2-6003-4050-8a61-44b250004627 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:32.362776 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b88947e2-6003-4050-8a61-44b250004627 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:32.370709 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b88947e2-6003-4050-8a61-44b250004627 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.166572 Jul 28 18:06:32.371263 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 293/579] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:32 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:32.450032 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7999e0b7-a2ac-4e4b-909f-6d16b9aea067 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:32.450656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7999e0b7-a2ac-4e4b-909f-6d16b9aea067 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:32.457979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7999e0b7-a2ac-4e4b-909f-6d16b9aea067 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:32.458451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7999e0b7-a2ac-4e4b-909f-6d16b9aea067 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:32.459210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7999e0b7-a2ac-4e4b-909f-6d16b9aea067 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:32.459636 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7999e0b7-a2ac-4e4b-909f-6d16b9aea067 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:32.564346 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-539ac639-9d49-4cfe-a85b-921b9cd14f60 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:32.564953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-539ac639-9d49-4cfe-a85b-921b9cd14f60 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:32.570904 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-539ac639-9d49-4cfe-a85b-921b9cd14f60 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:32.571344 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-539ac639-9d49-4cfe-a85b-921b9cd14f60 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:32.572140 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-539ac639-9d49-4cfe-a85b-921b9cd14f60 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:32.572569 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-539ac639-9d49-4cfe-a85b-921b9cd14f60 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:32.611817 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7999e0b7-a2ac-4e4b-909f-6d16b9aea067 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:32.620214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7999e0b7-a2ac-4e4b-909f-6d16b9aea067 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.173867 Jul 28 18:06:32.620797 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 287/580] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:32 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:32.708560 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-539ac639-9d49-4cfe-a85b-921b9cd14f60 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:32.716341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-539ac639-9d49-4cfe-a85b-921b9cd14f60 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.156648 Jul 28 18:06:32.716906 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 294/581] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:32 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:33.113870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-425b9ce0-9f31-46c6-8731-644c456d0153 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:33.114535 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-425b9ce0-9f31-46c6-8731-644c456d0153 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:33.120658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-425b9ce0-9f31-46c6-8731-644c456d0153 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.121025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-425b9ce0-9f31-46c6-8731-644c456d0153 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.121781 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-425b9ce0-9f31-46c6-8731-644c456d0153 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.122276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-425b9ce0-9f31-46c6-8731-644c456d0153 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.210277 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-0bfe4b0e-a641-4337-b4e2-4ad9a18f8474 req-bb4a76db-6288-43cb-85b5-49338a3ee7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb343d5-d21e-4542-a9b9-699415dbbb36", "name": "network-vif-plugged", "status": "completed", "tag": "fe531d4b-eb49-4238-84c1-95c99ca13d2c"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:33.223375 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-0bfe4b0e-a641-4337-b4e2-4ad9a18f8474 req-bb4a76db-6288-43cb-85b5-49338a3ee7e2 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.223924 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-0bfe4b0e-a641-4337-b4e2-4ad9a18f8474 req-bb4a76db-6288-43cb-85b5-49338a3ee7e2 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.238254 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-0bfe4b0e-a641-4337-b4e2-4ad9a18f8474 req-bb4a76db-6288-43cb-85b5-49338a3ee7e2 service nova] Creating event network-vif-plugged:fe531d4b-eb49-4238-84c1-95c99ca13d2c for instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 on hv-cinder-83754 Jul 28 18:06:33.244292 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-0bfe4b0e-a641-4337-b4e2-4ad9a18f8474 req-bb4a76db-6288-43cb-85b5-49338a3ee7e2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037723 Jul 28 18:06:33.245886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 295/582] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:06:33.272630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-425b9ce0-9f31-46c6-8731-644c456d0153 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:33.281296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-425b9ce0-9f31-46c6-8731-644c456d0153 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.171927 Jul 28 18:06:33.281866 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 288/583] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:33 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:33.391963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-988c9fdd-3e1e-4930-9094-ee5b97d90312 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:33.392586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-988c9fdd-3e1e-4930-9094-ee5b97d90312 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:33.399035 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-988c9fdd-3e1e-4930-9094-ee5b97d90312 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.399474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-988c9fdd-3e1e-4930-9094-ee5b97d90312 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.402024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-988c9fdd-3e1e-4930-9094-ee5b97d90312 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.402024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-988c9fdd-3e1e-4930-9094-ee5b97d90312 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.542489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-988c9fdd-3e1e-4930-9094-ee5b97d90312 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:33.551314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-988c9fdd-3e1e-4930-9094-ee5b97d90312 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.163768 Jul 28 18:06:33.551886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 296/584] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:33 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:33.643835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-883e8058-5970-4647-a8dd-5bf0537b3f1e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:33.644583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-883e8058-5970-4647-a8dd-5bf0537b3f1e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:33.651304 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-883e8058-5970-4647-a8dd-5bf0537b3f1e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.651751 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-883e8058-5970-4647-a8dd-5bf0537b3f1e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.652571 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-883e8058-5970-4647-a8dd-5bf0537b3f1e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.653006 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-883e8058-5970-4647-a8dd-5bf0537b3f1e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.737618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-239a740b-3c7c-4a3e-a6c5-08b0188acb64 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:33.738620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-239a740b-3c7c-4a3e-a6c5-08b0188acb64 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:33.745526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-239a740b-3c7c-4a3e-a6c5-08b0188acb64 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.746177 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-239a740b-3c7c-4a3e-a6c5-08b0188acb64 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.747134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-239a740b-3c7c-4a3e-a6c5-08b0188acb64 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:33.747767 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-239a740b-3c7c-4a3e-a6c5-08b0188acb64 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:33.847489 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-883e8058-5970-4647-a8dd-5bf0537b3f1e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:33.855663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-883e8058-5970-4647-a8dd-5bf0537b3f1e tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.216387 Jul 28 18:06:33.870702 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 289/585] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:33 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:33.910674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-239a740b-3c7c-4a3e-a6c5-08b0188acb64 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:33.918954 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-239a740b-3c7c-4a3e-a6c5-08b0188acb64 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.185438 Jul 28 18:06:33.919551 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 297/586] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:33 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:34.302411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0b5bd3b1-7107-4245-934d-31b627d83d6f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:34.303079 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0b5bd3b1-7107-4245-934d-31b627d83d6f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:34.309117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0b5bd3b1-7107-4245-934d-31b627d83d6f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:34.309565 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0b5bd3b1-7107-4245-934d-31b627d83d6f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:34.310414 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0b5bd3b1-7107-4245-934d-31b627d83d6f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:34.310848 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0b5bd3b1-7107-4245-934d-31b627d83d6f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:34.449266 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0b5bd3b1-7107-4245-934d-31b627d83d6f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:34.457677 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0b5bd3b1-7107-4245-934d-31b627d83d6f tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.159114 Jul 28 18:06:34.459903 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 290/587] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:34 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:34.573251 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e5e1be6a-0771-41ce-b661-128201a65bdf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:34.573867 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e5e1be6a-0771-41ce-b661-128201a65bdf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:34.580392 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e5e1be6a-0771-41ce-b661-128201a65bdf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:34.580838 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e5e1be6a-0771-41ce-b661-128201a65bdf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:34.581608 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e5e1be6a-0771-41ce-b661-128201a65bdf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:34.582039 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e5e1be6a-0771-41ce-b661-128201a65bdf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:34.713877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e5e1be6a-0771-41ce-b661-128201a65bdf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:34.722128 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e5e1be6a-0771-41ce-b661-128201a65bdf tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.152983 Jul 28 18:06:34.722716 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 298/588] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:34 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:34.879597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ab64ddba-b2ba-48d1-9141-5ba98f67b999 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:34.880264 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ab64ddba-b2ba-48d1-9141-5ba98f67b999 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:34.886691 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab64ddba-b2ba-48d1-9141-5ba98f67b999 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:34.887132 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab64ddba-b2ba-48d1-9141-5ba98f67b999 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:34.887886 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab64ddba-b2ba-48d1-9141-5ba98f67b999 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:34.888317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab64ddba-b2ba-48d1-9141-5ba98f67b999 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:34.894864 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:34.940565 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c08c45fe-5830-4284-8874-da59c1311e83 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:34.941177 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c08c45fe-5830-4284-8874-da59c1311e83 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:34.947412 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c08c45fe-5830-4284-8874-da59c1311e83 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:34.947895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c08c45fe-5830-4284-8874-da59c1311e83 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:34.948764 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c08c45fe-5830-4284-8874-da59c1311e83 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:34.949215 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c08c45fe-5830-4284-8874-da59c1311e83 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:35.054983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ab64ddba-b2ba-48d1-9141-5ba98f67b999 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:35.066325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ab64ddba-b2ba-48d1-9141-5ba98f67b999 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.190517 Jul 28 18:06:35.066936 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 291/589] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:34 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:35.129866 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c08c45fe-5830-4284-8874-da59c1311e83 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:35.137584 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c08c45fe-5830-4284-8874-da59c1311e83 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.201645 Jul 28 18:06:35.142096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 299/590] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:34 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:35.267365 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-16de693e-c090-4aa8-822e-13f95fdd5fcd req-1bff2e6d-1925-4fb9-81ca-6c40176b9a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1642e2-8e19-4214-8ada-503d731de538", "name": "network-vif-plugged", "status": "completed", "tag": "e04a6944-3588-4a0b-9a97-45eafc96eeed"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:35.276906 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-16de693e-c090-4aa8-822e-13f95fdd5fcd req-1bff2e6d-1925-4fb9-81ca-6c40176b9a11 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:35.277342 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-16de693e-c090-4aa8-822e-13f95fdd5fcd req-1bff2e6d-1925-4fb9-81ca-6c40176b9a11 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:35.288732 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-16de693e-c090-4aa8-822e-13f95fdd5fcd req-1bff2e6d-1925-4fb9-81ca-6c40176b9a11 service nova] Creating event network-vif-plugged:e04a6944-3588-4a0b-9a97-45eafc96eeed for instance 1f1642e2-8e19-4214-8ada-503d731de538 on hv-cinder-83754 Jul 28 18:06:35.293576 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-16de693e-c090-4aa8-822e-13f95fdd5fcd req-1bff2e6d-1925-4fb9-81ca-6c40176b9a11 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030933 Jul 28 18:06:35.294193 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 292/591] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:35.479530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c17c7760-1efc-4322-8b12-b42a42e9bfec tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:35.480250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c17c7760-1efc-4322-8b12-b42a42e9bfec tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:35.486551 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c17c7760-1efc-4322-8b12-b42a42e9bfec tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:35.487002 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c17c7760-1efc-4322-8b12-b42a42e9bfec tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:35.487809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c17c7760-1efc-4322-8b12-b42a42e9bfec tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:35.488249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c17c7760-1efc-4322-8b12-b42a42e9bfec tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:35.618838 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c17c7760-1efc-4322-8b12-b42a42e9bfec tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:35.627684 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c17c7760-1efc-4322-8b12-b42a42e9bfec tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1319 microversion: 2.1 time: 0.152110 Jul 28 18:06:35.628351 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 300/592] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:35 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:35.744111 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b266c30b-296d-4a82-9383-7ffe83056fe2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:35.744918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b266c30b-296d-4a82-9383-7ffe83056fe2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:35.751772 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b266c30b-296d-4a82-9383-7ffe83056fe2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:35.752214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b266c30b-296d-4a82-9383-7ffe83056fe2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:35.752965 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b266c30b-296d-4a82-9383-7ffe83056fe2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:35.753396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b266c30b-296d-4a82-9383-7ffe83056fe2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:35.894059 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b266c30b-296d-4a82-9383-7ffe83056fe2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:35.902093 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b266c30b-296d-4a82-9383-7ffe83056fe2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.162190 Jul 28 18:06:35.902684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 293/593] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:35 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:36.093060 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-33849c27-d41d-4586-8b8e-1989caddfd94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:36.094155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-33849c27-d41d-4586-8b8e-1989caddfd94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:36.101842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-33849c27-d41d-4586-8b8e-1989caddfd94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:36.102288 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-33849c27-d41d-4586-8b8e-1989caddfd94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:36.103086 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-33849c27-d41d-4586-8b8e-1989caddfd94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:36.103518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-33849c27-d41d-4586-8b8e-1989caddfd94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:36.160106 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-31c3c94d-ce40-411b-a766-e9216e2f6416 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:36.160953 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-31c3c94d-ce40-411b-a766-e9216e2f6416 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:36.168168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-31c3c94d-ce40-411b-a766-e9216e2f6416 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:36.168622 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-31c3c94d-ce40-411b-a766-e9216e2f6416 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:36.169505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-31c3c94d-ce40-411b-a766-e9216e2f6416 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:36.169954 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-31c3c94d-ce40-411b-a766-e9216e2f6416 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:36.313297 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-31c3c94d-ce40-411b-a766-e9216e2f6416 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:36.322968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-31c3c94d-ce40-411b-a766-e9216e2f6416 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.167996 Jul 28 18:06:36.323451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 294/594] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:36 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:36.506566 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-33849c27-d41d-4586-8b8e-1989caddfd94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:36.514642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-33849c27-d41d-4586-8b8e-1989caddfd94 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.425348 Jul 28 18:06:36.526475 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 301/595] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:36 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:36.649317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-90ae0b32-e1ab-4ee7-84ff-ba3f5667978a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:36.649849 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-90ae0b32-e1ab-4ee7-84ff-ba3f5667978a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:36.656065 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-90ae0b32-e1ab-4ee7-84ff-ba3f5667978a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:36.656511 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-90ae0b32-e1ab-4ee7-84ff-ba3f5667978a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:36.657275 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-90ae0b32-e1ab-4ee7-84ff-ba3f5667978a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:36.657713 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-90ae0b32-e1ab-4ee7-84ff-ba3f5667978a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:36.790506 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-90ae0b32-e1ab-4ee7-84ff-ba3f5667978a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:36.799385 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-90ae0b32-e1ab-4ee7-84ff-ba3f5667978a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1507 microversion: 2.1 time: 0.154059 Jul 28 18:06:36.799962 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 295/596] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:36 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:36.925231 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8bb7e160-e601-4531-88ea-63c874610b4c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:36.925940 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8bb7e160-e601-4531-88ea-63c874610b4c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:36.932451 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8bb7e160-e601-4531-88ea-63c874610b4c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:36.932908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8bb7e160-e601-4531-88ea-63c874610b4c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:36.933683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8bb7e160-e601-4531-88ea-63c874610b4c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:36.934215 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8bb7e160-e601-4531-88ea-63c874610b4c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:37.074109 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8bb7e160-e601-4531-88ea-63c874610b4c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:37.076697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:37.083268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8bb7e160-e601-4531-88ea-63c874610b4c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.163706 Jul 28 18:06:37.083843 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 302/597] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:36 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:37.345077 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-19001825-0795-475c-ae6b-c8e148f12550 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:37.345683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-19001825-0795-475c-ae6b-c8e148f12550 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:37.352182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-19001825-0795-475c-ae6b-c8e148f12550 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:37.352608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-19001825-0795-475c-ae6b-c8e148f12550 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:37.353368 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-19001825-0795-475c-ae6b-c8e148f12550 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:37.353800 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-19001825-0795-475c-ae6b-c8e148f12550 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:37.498157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-19001825-0795-475c-ae6b-c8e148f12550 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:37.501103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-19001825-0795-475c-ae6b-c8e148f12550 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1267 microversion: 2.1 time: 0.160408 Jul 28 18:06:37.501649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 296/598] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:37 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:37.537447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-14f7a6cc-b387-44b7-b82f-c60d7d53bcc9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:37.538094 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-14f7a6cc-b387-44b7-b82f-c60d7d53bcc9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:37.544994 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-14f7a6cc-b387-44b7-b82f-c60d7d53bcc9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:37.545484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-14f7a6cc-b387-44b7-b82f-c60d7d53bcc9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:37.546754 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-14f7a6cc-b387-44b7-b82f-c60d7d53bcc9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:37.547190 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-14f7a6cc-b387-44b7-b82f-c60d7d53bcc9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:37.698223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-14f7a6cc-b387-44b7-b82f-c60d7d53bcc9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:37.706759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-14f7a6cc-b387-44b7-b82f-c60d7d53bcc9 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.173528 Jul 28 18:06:37.707329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 303/599] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:37 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:38.104942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-86745dc8-e4ac-489b-9da6-cba239987d07 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:38.105611 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-86745dc8-e4ac-489b-9da6-cba239987d07 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:38.114388 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86745dc8-e4ac-489b-9da6-cba239987d07 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.114859 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86745dc8-e4ac-489b-9da6-cba239987d07 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.116064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86745dc8-e4ac-489b-9da6-cba239987d07 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.116535 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86745dc8-e4ac-489b-9da6-cba239987d07 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.257062 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-86745dc8-e4ac-489b-9da6-cba239987d07 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:38.265863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-86745dc8-e4ac-489b-9da6-cba239987d07 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.164642 Jul 28 18:06:38.266445 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 297/600] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:38 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:38.465756 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ea669ceb-b128-4fba-bcdf-5b980743b11c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:38.466282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ea669ceb-b128-4fba-bcdf-5b980743b11c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:38.472945 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea669ceb-b128-4fba-bcdf-5b980743b11c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.473393 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea669ceb-b128-4fba-bcdf-5b980743b11c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.474155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea669ceb-b128-4fba-bcdf-5b980743b11c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.474623 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea669ceb-b128-4fba-bcdf-5b980743b11c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.509414 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ea669ceb-b128-4fba-bcdf-5b980743b11c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments/2a7190da-a0b1-4bac-98b3-f4290437c17c" status: 200 len: 194 microversion: 2.20 time: 0.049014 Jul 28 18:06:38.511674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 304/601] 10.222.0.85 () {60 vars in 1454 bytes} [Thu Jul 28 18:06:38 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments/2a7190da-a0b1-4bac-98b3-f4290437c17c => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:06:38.521216 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2b9ff2c8-949b-42b2-a4e2-7434ce739ced tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:38.521968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2b9ff2c8-949b-42b2-a4e2-7434ce739ced tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:38.528820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2b9ff2c8-949b-42b2-a4e2-7434ce739ced tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.529342 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2b9ff2c8-949b-42b2-a4e2-7434ce739ced tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.530137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2b9ff2c8-949b-42b2-a4e2-7434ce739ced tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.531127 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2b9ff2c8-949b-42b2-a4e2-7434ce739ced tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.582117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4f2ce832-6116-48b3-8acc-28fa760f33bd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:38.582638 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4f2ce832-6116-48b3-8acc-28fa760f33bd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:38.591990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4f2ce832-6116-48b3-8acc-28fa760f33bd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.592434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4f2ce832-6116-48b3-8acc-28fa760f33bd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.593928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4f2ce832-6116-48b3-8acc-28fa760f33bd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.594639 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4f2ce832-6116-48b3-8acc-28fa760f33bd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.674777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2b9ff2c8-949b-42b2-a4e2-7434ce739ced tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:38.682983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2b9ff2c8-949b-42b2-a4e2-7434ce739ced tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1453 microversion: 2.1 time: 0.165578 Jul 28 18:06:38.683866 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 298/602] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:38 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:38.705202 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5e5b747b-9967-4c5f-bf7c-6f58d6f4b29b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:38.705876 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5e5b747b-9967-4c5f-bf7c-6f58d6f4b29b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:38.712310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5e5b747b-9967-4c5f-bf7c-6f58d6f4b29b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.712836 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5e5b747b-9967-4c5f-bf7c-6f58d6f4b29b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.713670 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5e5b747b-9967-4c5f-bf7c-6f58d6f4b29b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.714105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5e5b747b-9967-4c5f-bf7c-6f58d6f4b29b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.725219 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-4f2ce832-6116-48b3-8acc-28fa760f33bd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lazy-loading 'services' on Instance uuid 8f64c566-cf5d-4240-95e2-c5746a5bba89 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:06:38.854181 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5e5b747b-9967-4c5f-bf7c-6f58d6f4b29b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:38.862588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5e5b747b-9967-4c5f-bf7c-6f58d6f4b29b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1453 microversion: 2.1 time: 0.161874 Jul 28 18:06:38.863150 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 299/603] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:38 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:38.868427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7494b99d-2f52-46fc-aca4-f4d6254d5f12 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:38.869040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7494b99d-2f52-46fc-aca4-f4d6254d5f12 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:38.875287 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7494b99d-2f52-46fc-aca4-f4d6254d5f12 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.875739 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7494b99d-2f52-46fc-aca4-f4d6254d5f12 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:38.876512 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7494b99d-2f52-46fc-aca4-f4d6254d5f12 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:38.876949 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7494b99d-2f52-46fc-aca4-f4d6254d5f12 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:39.024420 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4f2ce832-6116-48b3-8acc-28fa760f33bd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments/2a7190da-a0b1-4bac-98b3-f4290437c17c" status: 202 len: 0 microversion: 2.20 time: 0.446573 Jul 28 18:06:39.025657 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 305/604] 10.222.0.85 () {60 vars in 1457 bytes} [Thu Jul 28 18:06:38 2022] DELETE /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments/2a7190da-a0b1-4bac-98b3-f4290437c17c => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:06:39.035432 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-33627d86-3205-4c62-b614-7c264f6db1a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:39.038255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-33627d86-3205-4c62-b614-7c264f6db1a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:39.038917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7494b99d-2f52-46fc-aca4-f4d6254d5f12 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:39.045048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-33627d86-3205-4c62-b614-7c264f6db1a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:39.048727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-33627d86-3205-4c62-b614-7c264f6db1a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:39.048727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-33627d86-3205-4c62-b614-7c264f6db1a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:39.048727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-33627d86-3205-4c62-b614-7c264f6db1a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:39.049032 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7494b99d-2f52-46fc-aca4-f4d6254d5f12 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1756 microversion: 2.1 time: 0.183288 Jul 28 18:06:39.049032 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 300/605] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:38 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:39.089356 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-33627d86-3205-4c62-b614-7c264f6db1a7 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059387 Jul 28 18:06:39.090157 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 306/606] 10.222.0.85 () {60 vars in 1343 bytes} [Thu Jul 28 18:06:39 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 18:06:39.290720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e083429f-5296-4cde-a4d3-45b7d23df2e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:39.291595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e083429f-5296-4cde-a4d3-45b7d23df2e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:39.298676 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e083429f-5296-4cde-a4d3-45b7d23df2e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:39.299238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e083429f-5296-4cde-a4d3-45b7d23df2e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:39.300215 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e083429f-5296-4cde-a4d3-45b7d23df2e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:39.300805 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e083429f-5296-4cde-a4d3-45b7d23df2e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:39.440715 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e083429f-5296-4cde-a4d3-45b7d23df2e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:39.448990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e083429f-5296-4cde-a4d3-45b7d23df2e8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.163679 Jul 28 18:06:39.449547 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 301/607] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:39 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:40.069627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-96909d07-637d-4b55-bd21-a83195a67c5c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:40.071226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-96909d07-637d-4b55-bd21-a83195a67c5c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:40.076871 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96909d07-637d-4b55-bd21-a83195a67c5c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:40.077497 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96909d07-637d-4b55-bd21-a83195a67c5c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:40.078517 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96909d07-637d-4b55-bd21-a83195a67c5c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:40.079068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-96909d07-637d-4b55-bd21-a83195a67c5c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:40.104194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3db7fd60-d437-44d1-a4ac-858a51293c66 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:40.106373 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3db7fd60-d437-44d1-a4ac-858a51293c66 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:40.114250 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3db7fd60-d437-44d1-a4ac-858a51293c66 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:40.114740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3db7fd60-d437-44d1-a4ac-858a51293c66 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:40.115519 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3db7fd60-d437-44d1-a4ac-858a51293c66 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:40.116092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3db7fd60-d437-44d1-a4ac-858a51293c66 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:40.147715 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3db7fd60-d437-44d1-a4ac-858a51293c66 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047491 Jul 28 18:06:40.148293 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 302/608] 10.222.0.85 () {60 vars in 1343 bytes} [Thu Jul 28 18:06:40 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:06:40.255956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-96909d07-637d-4b55-bd21-a83195a67c5c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:40.263368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-96909d07-637d-4b55-bd21-a83195a67c5c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1759 microversion: 2.1 time: 0.197555 Jul 28 18:06:40.263940 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 307/609] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:40 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1759 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:40.471096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-29a99da3-6572-4945-8071-1c8931e7c466 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:40.471780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-29a99da3-6572-4945-8071-1c8931e7c466 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:40.478143 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-29a99da3-6572-4945-8071-1c8931e7c466 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:40.480674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-29a99da3-6572-4945-8071-1c8931e7c466 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:40.481552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-29a99da3-6572-4945-8071-1c8931e7c466 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:40.481989 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-29a99da3-6572-4945-8071-1c8931e7c466 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:40.631301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-29a99da3-6572-4945-8071-1c8931e7c466 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:40.640269 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-29a99da3-6572-4945-8071-1c8931e7c466 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.173871 Jul 28 18:06:40.641100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 303/610] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:40 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:41.161172 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-151239cc-45f5-4eb9-99c2-d120a19c6b73 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:41.163341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-151239cc-45f5-4eb9-99c2-d120a19c6b73 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:41.171125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-151239cc-45f5-4eb9-99c2-d120a19c6b73 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:41.171892 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-151239cc-45f5-4eb9-99c2-d120a19c6b73 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:41.172680 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-151239cc-45f5-4eb9-99c2-d120a19c6b73 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:41.173123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-151239cc-45f5-4eb9-99c2-d120a19c6b73 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:41.211320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-151239cc-45f5-4eb9-99c2-d120a19c6b73 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054242 Jul 28 18:06:41.211804 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 308/611] 10.222.0.85 () {60 vars in 1343 bytes} [Thu Jul 28 18:06:41 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:06:41.246617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-8f4f248a-648d-438f-b87f-40f2bf0eae65 req-bd501efc-11d0-4053-a332-601de5764d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f1642e2-8e19-4214-8ada-503d731de538", "tag": "e04a6944-3588-4a0b-9a97-45eafc96eeed"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:41.256742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-8f4f248a-648d-438f-b87f-40f2bf0eae65 req-bd501efc-11d0-4053-a332-601de5764d21 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:41.257176 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-8f4f248a-648d-438f-b87f-40f2bf0eae65 req-bd501efc-11d0-4053-a332-601de5764d21 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:41.270510 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-8f4f248a-648d-438f-b87f-40f2bf0eae65 req-bd501efc-11d0-4053-a332-601de5764d21 service nova] Creating event network-changed:e04a6944-3588-4a0b-9a97-45eafc96eeed for instance 1f1642e2-8e19-4214-8ada-503d731de538 on hv-cinder-83754 Jul 28 18:06:41.276153 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-8f4f248a-648d-438f-b87f-40f2bf0eae65 req-bd501efc-11d0-4053-a332-601de5764d21 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032694 Jul 28 18:06:41.276511 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 304/612] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:06:41.663528 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ea07721b-1308-4842-ba99-55d4a4178247 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:41.664804 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ea07721b-1308-4842-ba99-55d4a4178247 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:41.672799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea07721b-1308-4842-ba99-55d4a4178247 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:41.673859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea07721b-1308-4842-ba99-55d4a4178247 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:41.674912 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea07721b-1308-4842-ba99-55d4a4178247 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:41.675356 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ea07721b-1308-4842-ba99-55d4a4178247 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:41.824692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ea07721b-1308-4842-ba99-55d4a4178247 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:41.847460 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ea07721b-1308-4842-ba99-55d4a4178247 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.186031 Jul 28 18:06:41.848433 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 309/613] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:41 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:42.223619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-18724b34-c0ed-4d01-a899-e0acbbdba02e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:42.225914 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-18724b34-c0ed-4d01-a899-e0acbbdba02e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:42.232256 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-18724b34-c0ed-4d01-a899-e0acbbdba02e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:42.232685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-18724b34-c0ed-4d01-a899-e0acbbdba02e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:42.234098 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-18724b34-c0ed-4d01-a899-e0acbbdba02e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:42.234726 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-18724b34-c0ed-4d01-a899-e0acbbdba02e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:42.265410 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-18724b34-c0ed-4d01-a899-e0acbbdba02e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046040 Jul 28 18:06:42.265869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 305/614] 10.222.0.85 () {60 vars in 1343 bytes} [Thu Jul 28 18:06:42 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:42.335094 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6145d7df-05d2-45e9-9d7c-df9c6f7ea0c4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:42.335586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6145d7df-05d2-45e9-9d7c-df9c6f7ea0c4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:42.342616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6145d7df-05d2-45e9-9d7c-df9c6f7ea0c4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:42.344875 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6145d7df-05d2-45e9-9d7c-df9c6f7ea0c4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:42.345660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6145d7df-05d2-45e9-9d7c-df9c6f7ea0c4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:42.346092 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6145d7df-05d2-45e9-9d7c-df9c6f7ea0c4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:42.373445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6145d7df-05d2-45e9-9d7c-df9c6f7ea0c4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Going to try to terminate instance {{(pid=130400) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:06:42.481672 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-960786517", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-673230153", "security_groups": [{"name": "tempest-secgroup-smoke-370209573"}], "networks": [{"uuid": "1c084787-5094-41ea-8434-975f5790a5e1"}], "block_device_mapping_v2": [{"uuid": "210fe5c9-941b-4c3c-9bcf-5caa1e06c21d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:42.604746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.network.neutron [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] validate_networks() for [('1c084787-5094-41ea-8434-975f5790a5e1', None, None, None, None, None)] {{(pid=130401) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:06:42.679718 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6145d7df-05d2-45e9-9d7c-df9c6f7ea0c4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 204 len: 0 microversion: 2.20 time: 0.348217 Jul 28 18:06:42.680308 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 310/615] 10.222.0.85 () {60 vars in 1280 bytes} [Thu Jul 28 18:06:42 2022] DELETE /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 18:06:42.690775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:42.691500 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:42.697488 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:42.697932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:42.698725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:42.699156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:42.804952 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=92 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:42.847526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:42.856360 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:42.862527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:42.862527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9fd87b74-2b6f-4092-b3ac-2eed7afe961b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.174214 Jul 28 18:06:42.862527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 311/616] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:42 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:06:42.882064 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3b3b0564-692a-4c8b-9dda-e625342a0391 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:42.883117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3b3b0564-692a-4c8b-9dda-e625342a0391 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:42.890171 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b3b0564-692a-4c8b-9dda-e625342a0391 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:42.890654 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b3b0564-692a-4c8b-9dda-e625342a0391 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:42.891507 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b3b0564-692a-4c8b-9dda-e625342a0391 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:42.891946 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3b3b0564-692a-4c8b-9dda-e625342a0391 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:43.027972 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Flavor limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:06:43.028402 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Image limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:06:43.028875 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Flavor pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:06:43.029306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Image pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:06:43.029701 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:06:43.036036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3b3b0564-692a-4c8b-9dda-e625342a0391 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:43.039593 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:43.040226 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:43.041028 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:43.041471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:43.044486 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3b3b0564-692a-4c8b-9dda-e625342a0391 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.172714 Jul 28 18:06:43.045243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 312/617] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:42 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:43.059646 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Getting quotas for project efa7968cb99d4470b48f8ff2fd8bad7a. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:06:43.064544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Getting quotas for user 186ea84ee37d48c186190438adce39b9 and project efa7968cb99d4470b48f8ff2fd8bad7a. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:06:43.123100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Going to run 1 instances... {{(pid=130401) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:06:43.126301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='210fe5c9-941b-4c3c-9bcf-5caa1e06c21d',volume_size=None,volume_type=None)] {{(pid=130401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:06:43.534790 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d3438f08-4324-4adc-b816-8a9b9cb5ebf8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.056979 Jul 28 18:06:43.535565 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 306/618] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:06:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 18:06:43.547131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cbe1b6c4-c313-4e94-be5b-7464c80ff6b7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:43.551995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cbe1b6c4-c313-4e94-be5b-7464c80ff6b7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:43.601208 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cbe1b6c4-c313-4e94-be5b-7464c80ff6b7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:43.608145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cbe1b6c4-c313-4e94-be5b-7464c80ff6b7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1087 microversion: 2.1 time: 0.065537 Jul 28 18:06:43.609286 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 313/619] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:43 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1087 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:43.885896 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:43.886562 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:43.893177 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:43.893622 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:43.894434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:43.894867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:44.048381 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:44.057158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:44.058706 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:44.059876 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-42a3a3e5-d09b-4e91-8831-db127e9154da tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.178545 Jul 28 18:06:44.065117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 307/620] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:43 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:44.079553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c3ba14fc-c782-45af-9596-505b1e161371 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:44.080161 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c3ba14fc-c782-45af-9596-505b1e161371 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:44.086324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c3ba14fc-c782-45af-9596-505b1e161371 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:44.086802 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c3ba14fc-c782-45af-9596-505b1e161371 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:44.087564 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c3ba14fc-c782-45af-9596-505b1e161371 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:44.087997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c3ba14fc-c782-45af-9596-505b1e161371 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:44.224532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c3ba14fc-c782-45af-9596-505b1e161371 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:44.233502 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c3ba14fc-c782-45af-9596-505b1e161371 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.157527 Jul 28 18:06:44.234139 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 314/621] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:44 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:44.630013 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a98a2f4f-6f85-4980-bf20-d89404072189 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:44.631034 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a98a2f4f-6f85-4980-bf20-d89404072189 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:44.694181 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a98a2f4f-6f85-4980-bf20-d89404072189 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:44.701444 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a98a2f4f-6f85-4980-bf20-d89404072189 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1087 microversion: 2.1 time: 0.075351 Jul 28 18:06:44.702671 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 308/622] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:44 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:45.089340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:45.089949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:45.096268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:45.096714 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:45.097481 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:45.097915 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:45.241788 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:45.255661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:45.257801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:45.259391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-058f5d75-c0d5-4e41-919f-66a6737dced6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1724 microversion: 2.20 time: 0.173698 Jul 28 18:06:45.259952 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 315/623] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:45 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:45.264188 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-73d48ae4-2e55-41cd-9f95-ee97e3a9802e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:45.264834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-73d48ae4-2e55-41cd-9f95-ee97e3a9802e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:45.277608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-73d48ae4-2e55-41cd-9f95-ee97e3a9802e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:45.278066 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-73d48ae4-2e55-41cd-9f95-ee97e3a9802e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:45.279090 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-73d48ae4-2e55-41cd-9f95-ee97e3a9802e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:45.279740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-73d48ae4-2e55-41cd-9f95-ee97e3a9802e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:45.482536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-73d48ae4-2e55-41cd-9f95-ee97e3a9802e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:45.491756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-73d48ae4-2e55-41cd-9f95-ee97e3a9802e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.231391 Jul 28 18:06:45.492550 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 309/624] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:45 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:45.724490 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bbb88130-626a-4948-bfed-ca9d1af2addf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:45.725099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bbb88130-626a-4948-bfed-ca9d1af2addf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:45.732733 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bbb88130-626a-4948-bfed-ca9d1af2addf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:45.733181 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bbb88130-626a-4948-bfed-ca9d1af2addf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:45.733978 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bbb88130-626a-4948-bfed-ca9d1af2addf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:45.734444 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bbb88130-626a-4948-bfed-ca9d1af2addf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:45.806878 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bbb88130-626a-4948-bfed-ca9d1af2addf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:45.812699 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bbb88130-626a-4948-bfed-ca9d1af2addf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1185 microversion: 2.1 time: 0.091946 Jul 28 18:06:45.813318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 316/625] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:45 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:45.916563 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-d0f7e129-c847-4b9f-8dc6-d283dc020c76 req-4ac63ee9-adf3-48db-9b8d-6d3b82fbb26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f64c566-cf5d-4240-95e2-c5746a5bba89", "name": "network-vif-deleted", "tag": "8980c8f3-7810-4b7b-b88d-1b866e291a34"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:45.929199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-d0f7e129-c847-4b9f-8dc6-d283dc020c76 req-4ac63ee9-adf3-48db-9b8d-6d3b82fbb26d service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:45.929199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-d0f7e129-c847-4b9f-8dc6-d283dc020c76 req-4ac63ee9-adf3-48db-9b8d-6d3b82fbb26d service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:45.941146 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-d0f7e129-c847-4b9f-8dc6-d283dc020c76 req-4ac63ee9-adf3-48db-9b8d-6d3b82fbb26d service nova] Creating event network-vif-deleted:8980c8f3-7810-4b7b-b88d-1b866e291a34 for instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 on hv-cinder-83754 Jul 28 18:06:45.947194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-d0f7e129-c847-4b9f-8dc6-d283dc020c76 req-4ac63ee9-adf3-48db-9b8d-6d3b82fbb26d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037701 Jul 28 18:06:45.947976 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 310/626] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:46.285570 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:46.286392 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:46.293224 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:46.293748 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:46.294988 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:46.298068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:46.334024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:46.334589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:46.335259 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lazy-loading 'fault' on Instance uuid 8f64c566-cf5d-4240-95e2-c5746a5bba89 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:06:46.395998 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:46.399801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:46.408656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:46.410623 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:46.411973 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-211ddfae-5b1c-401a-99c0-b7c3af499235 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1371 microversion: 2.20 time: 0.130844 Jul 28 18:06:46.413703 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 317/627] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:46 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:06:46.519176 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-893bf4b9-06a3-47f2-bb85-036a6b62a35f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:46.519913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-893bf4b9-06a3-47f2-bb85-036a6b62a35f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:46.530707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-893bf4b9-06a3-47f2-bb85-036a6b62a35f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:46.530707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-893bf4b9-06a3-47f2-bb85-036a6b62a35f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:46.530707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-893bf4b9-06a3-47f2-bb85-036a6b62a35f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:46.530707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-893bf4b9-06a3-47f2-bb85-036a6b62a35f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:46.549689 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:46.700182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-893bf4b9-06a3-47f2-bb85-036a6b62a35f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:46.712521 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-893bf4b9-06a3-47f2-bb85-036a6b62a35f tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.197973 Jul 28 18:06:46.713388 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 311/628] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:46 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:46.837606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fdde4a6d-9363-4a2f-90af-1eed4723ef9c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:46.838273 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fdde4a6d-9363-4a2f-90af-1eed4723ef9c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:46.845722 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-9363-4a2f-90af-1eed4723ef9c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:46.846403 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-9363-4a2f-90af-1eed4723ef9c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:46.847516 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-9363-4a2f-90af-1eed4723ef9c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:46.847960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fdde4a6d-9363-4a2f-90af-1eed4723ef9c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:46.982603 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fdde4a6d-9363-4a2f-90af-1eed4723ef9c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:46.995477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fdde4a6d-9363-4a2f-90af-1eed4723ef9c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1203 microversion: 2.1 time: 0.162149 Jul 28 18:06:47.002009 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 318/629] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:46 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:47.437221 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:47.437999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:47.450529 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:47.455041 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:47.455041 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:47.455041 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:47.492239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:47.492723 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:47.493173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lazy-loading 'fault' on Instance uuid 8f64c566-cf5d-4240-95e2-c5746a5bba89 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:06:47.539929 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:47.548513 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:47.550011 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:47.551226 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-188e9a0c-f857-44e8-a71c-24ad35ffe502 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 200 len: 1371 microversion: 2.20 time: 0.118268 Jul 28 18:06:47.552086 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 312/630] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:47 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:47.735564 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0042c9a0-13d3-418c-a4fa-691deeb18996 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:47.736309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0042c9a0-13d3-418c-a4fa-691deeb18996 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:47.742574 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0042c9a0-13d3-418c-a4fa-691deeb18996 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:47.743021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0042c9a0-13d3-418c-a4fa-691deeb18996 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:47.743791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0042c9a0-13d3-418c-a4fa-691deeb18996 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:47.744282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0042c9a0-13d3-418c-a4fa-691deeb18996 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:47.885748 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0042c9a0-13d3-418c-a4fa-691deeb18996 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:47.894338 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0042c9a0-13d3-418c-a4fa-691deeb18996 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.163123 Jul 28 18:06:47.894937 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 319/631] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:47 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:48.024864 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-45e61cec-19cd-45bc-b257-284a7f47c049 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:48.025671 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-45e61cec-19cd-45bc-b257-284a7f47c049 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:48.032649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-45e61cec-19cd-45bc-b257-284a7f47c049 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:48.033158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-45e61cec-19cd-45bc-b257-284a7f47c049 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:48.033996 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-45e61cec-19cd-45bc-b257-284a7f47c049 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:48.034456 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-45e61cec-19cd-45bc-b257-284a7f47c049 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:48.186951 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-45e61cec-19cd-45bc-b257-284a7f47c049 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:48.200905 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-45e61cec-19cd-45bc-b257-284a7f47c049 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1270 microversion: 2.1 time: 0.179718 Jul 28 18:06:48.201720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 313/632] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:48 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:48.584993 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:48.591809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:48.595619 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:48.596078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:48.597439 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:48.597887 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:48.614291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] HTTP exception thrown: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Request method failure captured: Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 HTTP/1.1 Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8fsPLj_Z3T0XuJePQXJGOoOuELY6vA1cXtiUfOCGkJL7bBAe--PK6k7qmG_rjCbwE4nRwpIQD51kTzXfqXt3YKzOOmEBYK5tf72APNQrI89raY08kff4nBr6dHtgrqlpBqu-cjTYUKdw_7jh_pGoUtmOmohMJPGbotPhutzsF0ubI Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:06:48.616384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2732f627abb44936bedd3293898b24f3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2732f627abb44936bedd3293898b24f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: f740005b7fc245919a6ddbf61ee9ba85 Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:06:48.617932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '8f64c566-cf5d-4240-95e2-c5746a5bba89'} Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:06:48.619586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:06:48.621386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:48.624817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Returning 404 to user: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:06:48.624817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5f5acc18-d9b7-4b5b-a60a-d0c90fa9d0a1 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 404 len: 111 microversion: 2.20 time: 0.041694 Jul 28 18:06:48.626635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 320/633] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:48 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:06:48.634661 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8738d8c9-5186-4709-97cf-b253b8b9cae9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '.version_select at 0x7fdae02cfaf0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:48.767264 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8738d8c9-5186-4709-97cf-b253b8b9cae9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288542214" status: 204 len: 0 microversion: 2.20 time: 0.138246 Jul 28 18:06:48.767892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 314/634] 10.222.0.85 () {60 vars in 1262 bytes} [Thu Jul 28 18:06:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288542214 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 18:06:48.916808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1ba21d1a-a19d-493d-95d5-7803593e7e73 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:48.917419 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1ba21d1a-a19d-493d-95d5-7803593e7e73 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:48.925290 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ba21d1a-a19d-493d-95d5-7803593e7e73 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:48.925730 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ba21d1a-a19d-493d-95d5-7803593e7e73 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:48.926825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ba21d1a-a19d-493d-95d5-7803593e7e73 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:48.927277 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ba21d1a-a19d-493d-95d5-7803593e7e73 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:49.157524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1ba21d1a-a19d-493d-95d5-7803593e7e73 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:49.177923 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1ba21d1a-a19d-493d-95d5-7803593e7e73 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.265165 Jul 28 18:06:49.181533 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 321/635] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:48 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:49.224766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-231ebcc7-3f7c-42ad-a612-ba47e2b1412b tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:49.226706 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-231ebcc7-3f7c-42ad-a612-ba47e2b1412b tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:49.235541 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-231ebcc7-3f7c-42ad-a612-ba47e2b1412b tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:49.235993 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-231ebcc7-3f7c-42ad-a612-ba47e2b1412b tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:49.237032 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-231ebcc7-3f7c-42ad-a612-ba47e2b1412b tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:49.237480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-231ebcc7-3f7c-42ad-a612-ba47e2b1412b tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:49.578835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-231ebcc7-3f7c-42ad-a612-ba47e2b1412b tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:49.586624 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-231ebcc7-3f7c-42ad-a612-ba47e2b1412b tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1270 microversion: 2.1 time: 0.368025 Jul 28 18:06:49.587203 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 315/636] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:49 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1270 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:49.708346 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-9539bc0a-b1f4-450f-bf3e-ca8f1b2dc839 req-5c016169-851f-4aa9-b46d-c875b4411bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e56a37-546f-4aa0-a30d-7e0108b17796", "tag": "d86bf1f7-161e-40c1-a007-0a9f75542440"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:49.727212 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-9539bc0a-b1f4-450f-bf3e-ca8f1b2dc839 req-5c016169-851f-4aa9-b46d-c875b4411bc3 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:49.727653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-9539bc0a-b1f4-450f-bf3e-ca8f1b2dc839 req-5c016169-851f-4aa9-b46d-c875b4411bc3 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:49.741062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-9539bc0a-b1f4-450f-bf3e-ca8f1b2dc839 req-5c016169-851f-4aa9-b46d-c875b4411bc3 service nova] Creating event network-changed:d86bf1f7-161e-40c1-a007-0a9f75542440 for instance 08e56a37-546f-4aa0-a30d-7e0108b17796 on hv-cinder-83754 Jul 28 18:06:49.746596 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-9539bc0a-b1f4-450f-bf3e-ca8f1b2dc839 req-5c016169-851f-4aa9-b46d-c875b4411bc3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041785 Jul 28 18:06:49.747592 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 322/637] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:50.035858 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d2a24bbb-f889-41d9-8dfc-dec8f77ec7a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'create', calling method: .version_select at 0x7fdae033f790>, body: {"keypair": {"name": "tempest-keypair-1982793069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkr7lQzbu8X3Fr92ULCb2/YUZQBDVt0ZXLUqAGv3/wt+WkBVt5BIWXYPbKVn84SRHS2r5R1iq/8AReDvpYNv2FKU6X+aT6TJh575Q6evz8Ny6R7yVQvII6pXBW+H4WYNw=="}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:50.056163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-d2a24bbb-f889-41d9-8dfc-dec8f77ec7a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Getting quotas for project 2732f627abb44936bedd3293898b24f3. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:06:50.060037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-d2a24bbb-f889-41d9-8dfc-dec8f77ec7a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Getting quotas for user f740005b7fc245919a6ddbf61ee9ba85 and project 2732f627abb44936bedd3293898b24f3. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:06:50.189608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d2a24bbb-f889-41d9-8dfc-dec8f77ec7a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.157497 Jul 28 18:06:50.190138 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 316/638] 10.222.0.85 () {62 vars in 1200 bytes} [Thu Jul 28 18:06:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 18:06:50.208688 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3281e1d5-dca7-4937-ae90-9708f281d165 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:50.209413 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3281e1d5-dca7-4937-ae90-9708f281d165 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:50.215973 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3281e1d5-dca7-4937-ae90-9708f281d165 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:50.216469 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3281e1d5-dca7-4937-ae90-9708f281d165 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:50.217273 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3281e1d5-dca7-4937-ae90-9708f281d165 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:50.218629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3281e1d5-dca7-4937-ae90-9708f281d165 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:50.556283 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3281e1d5-dca7-4937-ae90-9708f281d165 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:50.564602 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3281e1d5-dca7-4937-ae90-9708f281d165 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1736 microversion: 2.1 time: 0.360120 Jul 28 18:06:50.565271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 323/639] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:50 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1736 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:50.609188 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-333d6946-e0b4-467f-a191-6401e5d9dee1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:50.609794 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-333d6946-e0b4-467f-a191-6401e5d9dee1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:50.616399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-333d6946-e0b4-467f-a191-6401e5d9dee1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:50.616847 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-333d6946-e0b4-467f-a191-6401e5d9dee1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:50.617632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-333d6946-e0b4-467f-a191-6401e5d9dee1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:50.618062 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-333d6946-e0b4-467f-a191-6401e5d9dee1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:50.824351 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-333d6946-e0b4-467f-a191-6401e5d9dee1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:50.832514 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-333d6946-e0b4-467f-a191-6401e5d9dee1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.228361 Jul 28 18:06:50.833097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 317/640] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:50 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:51.586871 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a229d580-e644-4083-8f9f-af847677864e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:51.587516 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a229d580-e644-4083-8f9f-af847677864e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:51.595062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a229d580-e644-4083-8f9f-af847677864e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:51.595514 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a229d580-e644-4083-8f9f-af847677864e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:51.596369 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a229d580-e644-4083-8f9f-af847677864e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:51.596813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a229d580-e644-4083-8f9f-af847677864e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:51.807312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a229d580-e644-4083-8f9f-af847677864e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:51.817088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a229d580-e644-4083-8f9f-af847677864e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1716 microversion: 2.1 time: 0.234142 Jul 28 18:06:51.817841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 324/641] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:51 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1716 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:51.854569 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cf52a778-5cd4-4b67-bc93-1d2593d840ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:51.855502 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cf52a778-5cd4-4b67-bc93-1d2593d840ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:51.862765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cf52a778-5cd4-4b67-bc93-1d2593d840ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:51.863222 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cf52a778-5cd4-4b67-bc93-1d2593d840ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:51.864502 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cf52a778-5cd4-4b67-bc93-1d2593d840ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:51.864956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cf52a778-5cd4-4b67-bc93-1d2593d840ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:51.930328 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:51.930847 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:51.936794 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:51.937243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:51.937994 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:51.938449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:52.030956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] HTTP exception thrown: Cannot 'detach_volume' instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 while it is in vm_state rescued Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Request method failure captured: Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: DELETE /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments/722a33d4-f760-494c-88c8-753c03acc0b8 HTTP/1.1 Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8bdDylPe9TzYYahsE2YdUv8fsr0QRGbahEgRDZbkgtzcrOP3v03mdQwiM6MCmMl9eZdEVy4s00YMO7-3K7iXOaF5PeoG1oWSwvHUFyfpf5uOSXYen8iGBgKIrZ6fIcZity5LUFiDlgE-llaLEg0RohnQWVYBqmOcX-k2IkRZtnZgk Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:06:52.032580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c1c1587cf20d427e8bb03ffae1b1ce33", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 564e0f9000a1448ea9ea37a2892e6495 Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:06:52.039817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Cannot 'detach_volume' instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 while it is in vm_state rescued Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'server_id': '07dd071c-f443-4fbc-a37c-0b8b250968a4', 'id': '722a33d4-f760-494c-88c8-753c03acc0b8'} Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:06:52.040598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 while it is in vm_state rescued Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 while it is in vm_state rescued Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:06:52.042842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Returning 409 to user: Cannot 'detach_volume' instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 while it is in vm_state rescued {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:06:52.044136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6a3300d4-9257-49ba-97c7-d0b4907e3a92 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "DELETE /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments/722a33d4-f760-494c-88c8-753c03acc0b8" status: 409 len: 152 microversion: 2.1 time: 0.107622 Jul 28 18:06:52.044136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 325/642] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:06:51 2022] DELETE /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments/722a33d4-f760-494c-88c8-753c03acc0b8 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 28 18:06:52.050190 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ede011aa-b255-4f2e-be47-399fc08498a3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:52.051067 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ede011aa-b255-4f2e-be47-399fc08498a3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:52.059508 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ede011aa-b255-4f2e-be47-399fc08498a3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:52.060059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ede011aa-b255-4f2e-be47-399fc08498a3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:52.061373 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ede011aa-b255-4f2e-be47-399fc08498a3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:52.061993 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ede011aa-b255-4f2e-be47-399fc08498a3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:52.080064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-cf52a778-5cd4-4b67-bc93-1d2593d840ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:52.088931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cf52a778-5cd4-4b67-bc93-1d2593d840ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.238415 Jul 28 18:06:52.089504 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 318/643] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:51 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:52.425780 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ede011aa-b255-4f2e-be47-399fc08498a3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "POST /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/action" status: 202 len: 0 microversion: 2.1 time: 0.386676 Jul 28 18:06:52.430058 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 326/644] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:06:52 2022] POST /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:06:52.435544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4e299050-ce36-464c-a218-e9f021520074 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:52.436511 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4e299050-ce36-464c-a218-e9f021520074 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:52.444615 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4e299050-ce36-464c-a218-e9f021520074 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:52.445202 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4e299050-ce36-464c-a218-e9f021520074 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:52.446147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4e299050-ce36-464c-a218-e9f021520074 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:52.446734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4e299050-ce36-464c-a218-e9f021520074 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:52.624313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4e299050-ce36-464c-a218-e9f021520074 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:52.635089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4e299050-ce36-464c-a218-e9f021520074 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1724 microversion: 2.1 time: 0.203704 Jul 28 18:06:52.635845 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 319/645] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:52 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:52.849436 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-75668771", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "144cc463-6995-43c7-bdb8-22e214402d26"}], "security_groups": [{"name": "tempest-securitygroup--1702075063"}], "key_name": "tempest-keypair-1982793069", "user_data": "}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:52.958527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] validate_networks() for [('144cc463-6995-43c7-bdb8-22e214402d26', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:06:53.112305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-666017cb-865a-47d5-bd35-e0c4cad93103 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:53.113494 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-666017cb-865a-47d5-bd35-e0c4cad93103 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:53.115944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:53.125154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-666017cb-865a-47d5-bd35-e0c4cad93103 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:53.125802 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-666017cb-865a-47d5-bd35-e0c4cad93103 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:53.126763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-666017cb-865a-47d5-bd35-e0c4cad93103 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:53.127198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-666017cb-865a-47d5-bd35-e0c4cad93103 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:53.269870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-666017cb-865a-47d5-bd35-e0c4cad93103 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:53.277685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-666017cb-865a-47d5-bd35-e0c4cad93103 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.170745 Jul 28 18:06:53.278257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 320/646] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:53 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:53.356454 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:06:53.356877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:06:53.357348 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:06:53.357881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:06:53.358405 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:06:53.367556 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:53.368004 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:53.368799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:53.369237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:53.379770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:53.386765 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Getting quotas for project 2732f627abb44936bedd3293898b24f3. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:06:53.391353 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Getting quotas for user f740005b7fc245919a6ddbf61ee9ba85 and project 2732f627abb44936bedd3293898b24f3. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:06:53.402738 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:06:53.405809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:06:53.543863 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2aa10412-dd36-4834-8819-28f4a0a41329 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.699181 Jul 28 18:06:53.546447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 327/647] 10.222.0.85 () {62 vars in 1188 bytes} [Thu Jul 28 18:06:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 18:06:53.556426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-03609977-917e-4640-add2-e43698e58160 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:53.557351 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-03609977-917e-4640-add2-e43698e58160 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:53.615474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-03609977-917e-4640-add2-e43698e58160 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:53.623026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-03609977-917e-4640-add2-e43698e58160 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:53.625174 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-03609977-917e-4640-add2-e43698e58160 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:53.626286 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-03609977-917e-4640-add2-e43698e58160 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1280 microversion: 2.20 time: 0.074335 Jul 28 18:06:53.626869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 321/648] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:53 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1280 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:53.657057 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8e17b898-ecaa-475a-8c8b-5944dba5bd30 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:53.657672 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8e17b898-ecaa-475a-8c8b-5944dba5bd30 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:53.664819 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8e17b898-ecaa-475a-8c8b-5944dba5bd30 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:53.665274 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8e17b898-ecaa-475a-8c8b-5944dba5bd30 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:53.668961 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8e17b898-ecaa-475a-8c8b-5944dba5bd30 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:53.668961 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8e17b898-ecaa-475a-8c8b-5944dba5bd30 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:53.842825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8e17b898-ecaa-475a-8c8b-5944dba5bd30 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:53.852244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8e17b898-ecaa-475a-8c8b-5944dba5bd30 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1724 microversion: 2.1 time: 0.199800 Jul 28 18:06:53.853005 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 328/649] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:53 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:54.299420 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-109bc357-0c1a-4624-bb76-7c4028372136 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:54.300061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-109bc357-0c1a-4624-bb76-7c4028372136 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:54.307140 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-109bc357-0c1a-4624-bb76-7c4028372136 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:54.307587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-109bc357-0c1a-4624-bb76-7c4028372136 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:54.308370 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-109bc357-0c1a-4624-bb76-7c4028372136 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:54.308803 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-109bc357-0c1a-4624-bb76-7c4028372136 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:54.443298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-109bc357-0c1a-4624-bb76-7c4028372136 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:54.450726 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-109bc357-0c1a-4624-bb76-7c4028372136 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.155235 Jul 28 18:06:54.451287 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 322/650] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:54 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:54.650563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:54.651167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:54.658332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:54.658801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:54.659611 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:54.660073 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:54.722408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:54.730769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:54.735937 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:54.735937 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-86b7175b-819f-43f6-93a3-f1fd99043ecb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1284 microversion: 2.20 time: 0.086796 Jul 28 18:06:54.735937 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 329/651] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:54 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:54.875448 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9a0c07e8-ff9a-47d7-9a05-9dce80850a2b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:54.876064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9a0c07e8-ff9a-47d7-9a05-9dce80850a2b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:54.882109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9a0c07e8-ff9a-47d7-9a05-9dce80850a2b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:54.882612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9a0c07e8-ff9a-47d7-9a05-9dce80850a2b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:54.883429 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9a0c07e8-ff9a-47d7-9a05-9dce80850a2b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:54.883861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9a0c07e8-ff9a-47d7-9a05-9dce80850a2b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:55.022320 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9a0c07e8-ff9a-47d7-9a05-9dce80850a2b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:55.030896 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9a0c07e8-ff9a-47d7-9a05-9dce80850a2b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1724 microversion: 2.1 time: 0.159368 Jul 28 18:06:55.031358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 323/652] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:54 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:55.472527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-628a7e2f-fece-467b-895d-0bb75773fc51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:55.473235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-628a7e2f-fece-467b-895d-0bb75773fc51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:55.479223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-628a7e2f-fece-467b-895d-0bb75773fc51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:55.479671 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-628a7e2f-fece-467b-895d-0bb75773fc51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:55.480448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-628a7e2f-fece-467b-895d-0bb75773fc51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:55.480860 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-628a7e2f-fece-467b-895d-0bb75773fc51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:55.618662 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-628a7e2f-fece-467b-895d-0bb75773fc51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:55.626923 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-628a7e2f-fece-467b-895d-0bb75773fc51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.158220 Jul 28 18:06:55.630417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 330/653] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:55 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:55.699010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4e484fa3-82ed-4087-b934-cf58d0c63190 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9d13edb-260c-41d0-b666-25420ee63322", "device": "/dev/sdb"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:55.702204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4e484fa3-82ed-4087-b934-cf58d0c63190 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:55.709074 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4e484fa3-82ed-4087-b934-cf58d0c63190 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:55.709526 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4e484fa3-82ed-4087-b934-cf58d0c63190 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:55.710288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4e484fa3-82ed-4087-b934-cf58d0c63190 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:55.710750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4e484fa3-82ed-4087-b934-cf58d0c63190 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:55.756009 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:55.756612 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:55.763155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:55.763564 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:55.764596 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:55.765035 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:56.059271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:56.067315 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:56.068910 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:56.070004 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ff4137c8-9f9a-4dfa-bcde-caba2e2d65e4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1284 microversion: 2.20 time: 0.317786 Jul 28 18:06:56.070577 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 331/654] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:55 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1284 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:06:56.075526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5ed07b9d-545d-4794-9c15-138b59029a94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:56.076156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5ed07b9d-545d-4794-9c15-138b59029a94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:56.094907 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5ed07b9d-545d-4794-9c15-138b59029a94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:56.096046 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5ed07b9d-545d-4794-9c15-138b59029a94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:56.096167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5ed07b9d-545d-4794-9c15-138b59029a94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:56.096588 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5ed07b9d-545d-4794-9c15-138b59029a94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:56.233906 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5ed07b9d-545d-4794-9c15-138b59029a94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:56.242425 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5ed07b9d-545d-4794-9c15-138b59029a94 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1730 microversion: 2.1 time: 0.170651 Jul 28 18:06:56.243005 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 332/655] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:56 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:56.262837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ab13f842-d662-41b1-9e18-796d8c42e43b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:56.263359 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ab13f842-d662-41b1-9e18-796d8c42e43b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:56.270066 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab13f842-d662-41b1-9e18-796d8c42e43b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:56.274493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab13f842-d662-41b1-9e18-796d8c42e43b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:56.274493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab13f842-d662-41b1-9e18-796d8c42e43b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:56.274493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ab13f842-d662-41b1-9e18-796d8c42e43b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:56.357608 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ab13f842-d662-41b1-9e18-796d8c42e43b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098425 Jul 28 18:06:56.358696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 333/656] 10.222.0.85 () {58 vars in 1275 bytes} [Thu Jul 28 18:06:56 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:06:56.656534 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d685e110-91c2-4eb2-9e80-f29a87ac9147 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:56.657168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d685e110-91c2-4eb2-9e80-f29a87ac9147 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:56.666086 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d685e110-91c2-4eb2-9e80-f29a87ac9147 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:56.666574 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d685e110-91c2-4eb2-9e80-f29a87ac9147 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:56.667348 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d685e110-91c2-4eb2-9e80-f29a87ac9147 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:56.667786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d685e110-91c2-4eb2-9e80-f29a87ac9147 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:56.801837 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4e484fa3-82ed-4087-b934-cf58d0c63190 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "POST /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.106578 Jul 28 18:06:56.802489 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 324/657] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:06:55 2022] POST /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36/os-volume_attachments => generated 194 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:56.922927 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d685e110-91c2-4eb2-9e80-f29a87ac9147 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:56.930444 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d685e110-91c2-4eb2-9e80-f29a87ac9147 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.278500 Jul 28 18:06:56.931016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 334/658] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:56 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:06:57.095578 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:57.096267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:57.102530 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:57.103236 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:57.104041 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:57.104473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:57.171631 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:57.180303 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:57.181819 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:57.182959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b9f8bf0c-f616-4786-b2cf-4a1f1df5555e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1332 microversion: 2.20 time: 0.092235 Jul 28 18:06:57.183516 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 325/659] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:57 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:57.463963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-898bf8e0-e462-456f-a8c8-c855b8f740b0 req-0a7b4e21-9c3e-4c26-874f-6a761760aac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dd071c-f443-4fbc-a37c-0b8b250968a4", "tag": "9f9562ad-51bd-4d8e-b76b-7edbbe736d9f"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:57.474456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-898bf8e0-e462-456f-a8c8-c855b8f740b0 req-0a7b4e21-9c3e-4c26-874f-6a761760aac1 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:57.475114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-898bf8e0-e462-456f-a8c8-c855b8f740b0 req-0a7b4e21-9c3e-4c26-874f-6a761760aac1 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:57.488351 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-898bf8e0-e462-456f-a8c8-c855b8f740b0 req-0a7b4e21-9c3e-4c26-874f-6a761760aac1 service nova] Creating event network-changed:9f9562ad-51bd-4d8e-b76b-7edbbe736d9f for instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 on hv-cinder-83754 Jul 28 18:06:57.493646 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-898bf8e0-e462-456f-a8c8-c855b8f740b0 req-0a7b4e21-9c3e-4c26-874f-6a761760aac1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033284 Jul 28 18:06:57.494750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 335/660] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:06:57.953441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1b27610d-2da6-46a3-978c-c2b5d184324a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:57.956605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1b27610d-2da6-46a3-978c-c2b5d184324a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:57.960734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1b27610d-2da6-46a3-978c-c2b5d184324a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:57.961182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1b27610d-2da6-46a3-978c-c2b5d184324a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:57.961946 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1b27610d-2da6-46a3-978c-c2b5d184324a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:57.968868 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1b27610d-2da6-46a3-978c-c2b5d184324a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:58.208021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:58.208732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:58.220456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:58.225608 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:58.227254 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:58.227867 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:58.243372 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1b27610d-2da6-46a3-978c-c2b5d184324a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:58.246830 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:06:58.255773 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1b27610d-2da6-46a3-978c-c2b5d184324a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.305960 Jul 28 18:06:58.256883 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 326/661] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:57 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:58.311246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:58.323461 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:58.325341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:58.328351 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ebf324da-f214-4a69-bd6e-40a69d2438ac tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1340 microversion: 2.20 time: 0.125283 Jul 28 18:06:58.332852 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 336/662] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:58 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1340 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:06:59.277121 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-64520818-a9a9-4161-b6d1-0c51cfea51c0 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:59.277856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-64520818-a9a9-4161-b6d1-0c51cfea51c0 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:59.285578 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64520818-a9a9-4161-b6d1-0c51cfea51c0 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:59.286030 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64520818-a9a9-4161-b6d1-0c51cfea51c0 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:59.286938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64520818-a9a9-4161-b6d1-0c51cfea51c0 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:59.287378 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-64520818-a9a9-4161-b6d1-0c51cfea51c0 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:59.363653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:06:59.364249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:06:59.372122 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:59.372504 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:59.374249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:59.375124 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:59.516259 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-64520818-a9a9-4161-b6d1-0c51cfea51c0 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:59.524919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-64520818-a9a9-4161-b6d1-0c51cfea51c0 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.251595 Jul 28 18:06:59.525838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 327/663] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:06:59 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:06:59.532153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:59.538848 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-9095f3b6-f4d6-41b3-8184-894a7c2d38aa req-387f6066-310d-4eae-8b1f-55110456e5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07dd071c-f443-4fbc-a37c-0b8b250968a4", "tag": "9f9562ad-51bd-4d8e-b76b-7edbbe736d9f"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:06:59.543237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:59.544769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:06:59.546878 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bbbc6f04-d998-4de8-90e8-e4b5bf7a2687 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.188318 Jul 28 18:06:59.558481 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 337/664] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:06:59 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:06:59.558634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-9095f3b6-f4d6-41b3-8184-894a7c2d38aa req-387f6066-310d-4eae-8b1f-55110456e5a7 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:06:59.558634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-9095f3b6-f4d6-41b3-8184-894a7c2d38aa req-387f6066-310d-4eae-8b1f-55110456e5a7 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:06:59.562913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-9095f3b6-f4d6-41b3-8184-894a7c2d38aa req-387f6066-310d-4eae-8b1f-55110456e5a7 service nova] Creating event network-changed:9f9562ad-51bd-4d8e-b76b-7edbbe736d9f for instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 on hv-cinder-83754 Jul 28 18:06:59.567824 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-9095f3b6-f4d6-41b3-8184-894a7c2d38aa req-387f6066-310d-4eae-8b1f-55110456e5a7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040681 Jul 28 18:06:59.568412 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 328/665] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:00.239405 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-3cbee347-68c6-4389-83a7-913802648215 req-09faee91-8e4a-406d-b975-441498a1f959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ad8548-670a-4120-9652-2c63a78dd575", "tag": "7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:00.258206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-3cbee347-68c6-4389-83a7-913802648215 req-09faee91-8e4a-406d-b975-441498a1f959 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:00.258206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-3cbee347-68c6-4389-83a7-913802648215 req-09faee91-8e4a-406d-b975-441498a1f959 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:00.268842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-3cbee347-68c6-4389-83a7-913802648215 req-09faee91-8e4a-406d-b975-441498a1f959 service nova] Creating event network-changed:7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1 for instance b6ad8548-670a-4120-9652-2c63a78dd575 on hv-cinder-83754 Jul 28 18:07:00.273787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-3cbee347-68c6-4389-83a7-913802648215 req-09faee91-8e4a-406d-b975-441498a1f959 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038034 Jul 28 18:07:00.276635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 338/666] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:00.548677 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-122e6442-e1bd-48ec-9569-022d52d0f1de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:00.549376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-122e6442-e1bd-48ec-9569-022d52d0f1de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:00.555889 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-122e6442-e1bd-48ec-9569-022d52d0f1de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:00.556332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-122e6442-e1bd-48ec-9569-022d52d0f1de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:00.557100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-122e6442-e1bd-48ec-9569-022d52d0f1de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:00.557537 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-122e6442-e1bd-48ec-9569-022d52d0f1de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:00.571700 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:00.573238 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:00.581043 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:00.581486 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:00.582456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:00.582889 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:00.716232 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:00.722798 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-122e6442-e1bd-48ec-9569-022d52d0f1de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:00.725450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:00.726977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:00.728090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-57f5ed11-efaf-4701-8133-49848aafcfa5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.160613 Jul 28 18:07:00.731087 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-122e6442-e1bd-48ec-9569-022d52d0f1de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.187777 Jul 28 18:07:00.733720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 329/667] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:00 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:00.742753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 339/668] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:00 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:07:01.752738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:01.753352 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:01.753645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6d7af320-b882-46ae-baf8-71632f738f84 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:01.754330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6d7af320-b882-46ae-baf8-71632f738f84 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:01.759706 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:01.760153 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:01.760712 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d7af320-b882-46ae-baf8-71632f738f84 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:01.760933 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:01.761159 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d7af320-b882-46ae-baf8-71632f738f84 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:01.761436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:01.761928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d7af320-b882-46ae-baf8-71632f738f84 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:01.762368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d7af320-b882-46ae-baf8-71632f738f84 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:01.768033 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:01.916249 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:01.926275 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:01.927661 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:01.928769 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-28139500-04a0-4490-b753-b43605c27355 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.181148 Jul 28 18:07:01.929323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 330/669] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:01 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:07:01.929726 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6d7af320-b882-46ae-baf8-71632f738f84 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:01.937816 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6d7af320-b882-46ae-baf8-71632f738f84 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.188122 Jul 28 18:07:01.938382 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 340/670] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:01 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:02.952250 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:02.953812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:02.958870 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8fee004e-62b7-4f7f-88be-6141e797721d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:02.959573 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8fee004e-62b7-4f7f-88be-6141e797721d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:02.962406 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:02.963080 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:02.964096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:02.964722 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:02.969906 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8fee004e-62b7-4f7f-88be-6141e797721d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:02.970604 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8fee004e-62b7-4f7f-88be-6141e797721d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:02.971674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8fee004e-62b7-4f7f-88be-6141e797721d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:02.972276 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8fee004e-62b7-4f7f-88be-6141e797721d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:03.118626 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8fee004e-62b7-4f7f-88be-6141e797721d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:03.127848 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8fee004e-62b7-4f7f-88be-6141e797721d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.173083 Jul 28 18:07:03.131012 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 341/671] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:02 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:03.227840 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-e327bd83-34d2-492a-bc1f-c2dba1a06a12 req-cf236351-4e62-4c83-a2eb-58f8b0e6796a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e56a37-546f-4aa0-a30d-7e0108b17796", "name": "network-vif-plugged", "status": "completed", "tag": "d86bf1f7-161e-40c1-a007-0a9f75542440"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:03.240976 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:03.242145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-e327bd83-34d2-492a-bc1f-c2dba1a06a12 req-cf236351-4e62-4c83-a2eb-58f8b0e6796a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:03.242627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-e327bd83-34d2-492a-bc1f-c2dba1a06a12 req-cf236351-4e62-4c83-a2eb-58f8b0e6796a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:03.257813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-e327bd83-34d2-492a-bc1f-c2dba1a06a12 req-cf236351-4e62-4c83-a2eb-58f8b0e6796a service nova] Creating event network-vif-plugged:d86bf1f7-161e-40c1-a007-0a9f75542440 for instance 08e56a37-546f-4aa0-a30d-7e0108b17796 on hv-cinder-83754 Jul 28 18:07:03.258216 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:03.263229 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:03.264390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-e327bd83-34d2-492a-bc1f-c2dba1a06a12 req-cf236351-4e62-4c83-a2eb-58f8b0e6796a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039760 Jul 28 18:07:03.265184 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 342/672] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:03.265301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8fe6dfa7-46f7-4120-92d4-814d10599027 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.317699 Jul 28 18:07:03.265847 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 331/673] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:02 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:07:04.149044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:04.149717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=8 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:04.154211 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7da20ed3-9dbf-453c-885c-2efb00c6fb5f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:04.155371 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7da20ed3-9dbf-453c-885c-2efb00c6fb5f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:04.161680 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7da20ed3-9dbf-453c-885c-2efb00c6fb5f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:04.162125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7da20ed3-9dbf-453c-885c-2efb00c6fb5f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:04.162925 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7da20ed3-9dbf-453c-885c-2efb00c6fb5f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:04.163359 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7da20ed3-9dbf-453c-885c-2efb00c6fb5f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:04.287980 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:04.288806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:04.290736 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=14 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:04.296905 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:04.297356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:04.298136 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:04.298598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:04.302191 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7da20ed3-9dbf-453c-885c-2efb00c6fb5f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:04.313174 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7da20ed3-9dbf-453c-885c-2efb00c6fb5f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.165039 Jul 28 18:07:04.313890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 343/674] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:04 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:04.441892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:04.445255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:04.446855 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:04.447997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a6d4c65a-855e-436b-a173-87c26b74bded tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.163877 Jul 28 18:07:04.448543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 332/675] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:04 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:07:05.335395 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-16ffdebd-6745-4cb4-a6e5-5c9642487b63 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:05.335997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-16ffdebd-6745-4cb4-a6e5-5c9642487b63 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:05.342667 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-16ffdebd-6745-4cb4-a6e5-5c9642487b63 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:05.343137 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-16ffdebd-6745-4cb4-a6e5-5c9642487b63 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:05.343960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-16ffdebd-6745-4cb4-a6e5-5c9642487b63 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:05.344447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-16ffdebd-6745-4cb4-a6e5-5c9642487b63 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:05.471460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:05.473234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:05.480299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:05.480748 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:05.481548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:05.481979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:05.502844 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-16ffdebd-6745-4cb4-a6e5-5c9642487b63 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:05.510648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-16ffdebd-6745-4cb4-a6e5-5c9642487b63 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1258 microversion: 2.1 time: 0.179024 Jul 28 18:07:05.511186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 344/676] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:05 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:05.616535 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:05.624638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:05.626137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:05.627308 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e1e756b5-e97a-4908-a0f1-de5873d902cd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.160637 Jul 28 18:07:05.627865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 333/677] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:05 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:07:06.532402 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-df1146fe-ef03-405a-872a-9a60fbcc1c83 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:06.533009 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-df1146fe-ef03-405a-872a-9a60fbcc1c83 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:06.539936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-df1146fe-ef03-405a-872a-9a60fbcc1c83 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:06.540386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-df1146fe-ef03-405a-872a-9a60fbcc1c83 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:06.541146 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-df1146fe-ef03-405a-872a-9a60fbcc1c83 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:06.541581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-df1146fe-ef03-405a-872a-9a60fbcc1c83 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:06.649170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:06.649758 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:06.657033 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:06.657482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:06.658254 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:06.658713 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:06.675855 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-df1146fe-ef03-405a-872a-9a60fbcc1c83 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:06.683299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-df1146fe-ef03-405a-872a-9a60fbcc1c83 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1442 microversion: 2.1 time: 0.155403 Jul 28 18:07:06.684083 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 345/678] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:06 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1442 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:06.703913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-92bcc0d7-0c84-4f04-82e9-e84581ece379 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:06.704526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-92bcc0d7-0c84-4f04-82e9-e84581ece379 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:06.710634 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-92bcc0d7-0c84-4f04-82e9-e84581ece379 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:06.711024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-92bcc0d7-0c84-4f04-82e9-e84581ece379 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:06.711789 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-92bcc0d7-0c84-4f04-82e9-e84581ece379 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:06.712249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-92bcc0d7-0c84-4f04-82e9-e84581ece379 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:06.796971 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:06.806570 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:06.808983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:06.810238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4ada950d-0e8b-40c4-9d9a-3bca278bbe27 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.164861 Jul 28 18:07:06.811065 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 334/679] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:06 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:07:06.853525 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-92bcc0d7-0c84-4f04-82e9-e84581ece379 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:06.858616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-92bcc0d7-0c84-4f04-82e9-e84581ece379 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1442 microversion: 2.1 time: 0.159007 Jul 28 18:07:06.859183 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 346/680] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:06 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:07:07.386067 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-bc3c48c1-8f01-4583-9cdf-c13d5db4d9bc req-c1e5f41d-6fe4-4c8a-82a4-aa72772c8571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ad8548-670a-4120-9652-2c63a78dd575", "name": "network-vif-plugged", "status": "completed", "tag": "7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:07.397530 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-bc3c48c1-8f01-4583-9cdf-c13d5db4d9bc req-c1e5f41d-6fe4-4c8a-82a4-aa72772c8571 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:07.398276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-bc3c48c1-8f01-4583-9cdf-c13d5db4d9bc req-c1e5f41d-6fe4-4c8a-82a4-aa72772c8571 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:07.410152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-bc3c48c1-8f01-4583-9cdf-c13d5db4d9bc req-c1e5f41d-6fe4-4c8a-82a4-aa72772c8571 service nova] Creating event network-vif-plugged:7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1 for instance b6ad8548-670a-4120-9652-2c63a78dd575 on hv-cinder-83754 Jul 28 18:07:07.416141 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-bc3c48c1-8f01-4583-9cdf-c13d5db4d9bc req-c1e5f41d-6fe4-4c8a-82a4-aa72772c8571 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 Jul 28 18:07:07.416729 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 335/681] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:07.833313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:07.833885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:07.840704 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:07.841148 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:07.843172 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:07.843949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:08.374017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:08.384577 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:08.386128 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:08.387265 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7de86d98-5539-41ba-8fbd-bb7cab0a1f48 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.558057 Jul 28 18:07:08.387848 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 347/682] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:07 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:07:09.387703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-40b0d3d8-3f71-4b6b-a887-1eff2085822c req-9ff34ead-3ef5-4d15-a13c-c6dc84c256d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e56a37-546f-4aa0-a30d-7e0108b17796", "tag": "d86bf1f7-161e-40c1-a007-0a9f75542440"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:09.398318 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-40b0d3d8-3f71-4b6b-a887-1eff2085822c req-9ff34ead-3ef5-4d15-a13c-c6dc84c256d1 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:09.398787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-40b0d3d8-3f71-4b6b-a887-1eff2085822c req-9ff34ead-3ef5-4d15-a13c-c6dc84c256d1 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:09.410589 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-40b0d3d8-3f71-4b6b-a887-1eff2085822c req-9ff34ead-3ef5-4d15-a13c-c6dc84c256d1 service nova] Creating event network-changed:d86bf1f7-161e-40c1-a007-0a9f75542440 for instance 08e56a37-546f-4aa0-a30d-7e0108b17796 on hv-cinder-83754 Jul 28 18:07:09.413077 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:09.414515 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:09.415475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-40b0d3d8-3f71-4b6b-a887-1eff2085822c req-9ff34ead-3ef5-4d15-a13c-c6dc84c256d1 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032261 Jul 28 18:07:09.416061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 336/683] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:09.424196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:09.424707 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:09.425493 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:09.425923 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:09.570292 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:09.579723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:09.581292 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:09.582492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-86265eab-248f-4bd1-a664-9539296ff467 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1406 microversion: 2.20 time: 0.174531 Jul 28 18:07:09.583143 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 348/684] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:09 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:07:10.607045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:10.607792 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:10.614766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:10.615487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:10.616283 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:10.616723 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:10.754396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:10.762553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:10.764763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:10.765919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2db1cb0c-9164-436a-bbd5-03d4fe5becfe tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1598 microversion: 2.20 time: 0.164250 Jul 28 18:07:10.766499 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 337/685] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:07:10 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:07:10.787601 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-436ec679-9489-459c-bd60-7e8cc98a0062 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:10.788145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-436ec679-9489-459c-bd60-7e8cc98a0062 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:10.794969 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-436ec679-9489-459c-bd60-7e8cc98a0062 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:10.795411 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-436ec679-9489-459c-bd60-7e8cc98a0062 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:10.796167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-436ec679-9489-459c-bd60-7e8cc98a0062 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:10.796593 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-436ec679-9489-459c-bd60-7e8cc98a0062 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:10.878502 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-436ec679-9489-459c-bd60-7e8cc98a0062 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094661 Jul 28 18:07:10.879088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 349/686] 10.222.0.85 () {60 vars in 1316 bytes} [Thu Jul 28 18:07:10 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:07:11.921843 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-4ca604a6-6141-41cd-9e52-8a2a3c60fba7 req-ead0fbe1-ab73-4ff8-85fc-ad6a0ef50d09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ad8548-670a-4120-9652-2c63a78dd575", "tag": "7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:11.931792 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-4ca604a6-6141-41cd-9e52-8a2a3c60fba7 req-ead0fbe1-ab73-4ff8-85fc-ad6a0ef50d09 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:11.932238 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-4ca604a6-6141-41cd-9e52-8a2a3c60fba7 req-ead0fbe1-ab73-4ff8-85fc-ad6a0ef50d09 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:11.945421 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-4ca604a6-6141-41cd-9e52-8a2a3c60fba7 req-ead0fbe1-ab73-4ff8-85fc-ad6a0ef50d09 service nova] Creating event network-changed:7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1 for instance b6ad8548-670a-4120-9652-2c63a78dd575 on hv-cinder-83754 Jul 28 18:07:11.950937 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-4ca604a6-6141-41cd-9e52-8a2a3c60fba7 req-ead0fbe1-ab73-4ff8-85fc-ad6a0ef50d09 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032468 Jul 28 18:07:11.951542 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 338/687] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:26.177478 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:26.178314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=71 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:26.182394 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-50e7c40b-cecf-457b-89fc-c5938b151dd7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:26.182892 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-50e7c40b-cecf-457b-89fc-c5938b151dd7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:26.189687 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-50e7c40b-cecf-457b-89fc-c5938b151dd7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:26.193399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-50e7c40b-cecf-457b-89fc-c5938b151dd7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:26.193399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-50e7c40b-cecf-457b-89fc-c5938b151dd7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:26.193399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-50e7c40b-cecf-457b-89fc-c5938b151dd7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:26.286075 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-50e7c40b-cecf-457b-89fc-c5938b151dd7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lazy-loading 'services' on Instance uuid 4eb343d5-d21e-4542-a9b9-699415dbbb36 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:07:26.517473 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-50e7c40b-cecf-457b-89fc-c5938b151dd7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36/os-volume_attachments/b9d13edb-260c-41d0-b666-25420ee63322" status: 202 len: 0 microversion: 2.1 time: 0.341114 Jul 28 18:07:26.518069 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 350/688] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:07:26 2022] DELETE /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36/os-volume_attachments/b9d13edb-260c-41d0-b666-25420ee63322 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:07:28.698676 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:28.699448 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=40 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:28.703480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9fd73632-a0ea-4410-85b9-607d26fe8669 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:28.704092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9fd73632-a0ea-4410-85b9-607d26fe8669 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:28.710080 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9fd73632-a0ea-4410-85b9-607d26fe8669 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:28.711082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9fd73632-a0ea-4410-85b9-607d26fe8669 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:28.711356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9fd73632-a0ea-4410-85b9-607d26fe8669 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:28.711795 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9fd73632-a0ea-4410-85b9-607d26fe8669 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:28.738412 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9fd73632-a0ea-4410-85b9-607d26fe8669 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:07:29.083671 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9fd73632-a0ea-4410-85b9-607d26fe8669 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 204 len: 0 microversion: 2.1 time: 0.386279 Jul 28 18:07:29.084327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 339/689] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:07:28 2022] DELETE /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:07:29.093954 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-aebdeac3-5882-4483-800c-0ccee4bacafb tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:29.095151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-aebdeac3-5882-4483-800c-0ccee4bacafb tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:29.101088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aebdeac3-5882-4483-800c-0ccee4bacafb tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:29.101531 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aebdeac3-5882-4483-800c-0ccee4bacafb tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:29.102297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aebdeac3-5882-4483-800c-0ccee4bacafb tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:29.102769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aebdeac3-5882-4483-800c-0ccee4bacafb tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:29.242640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-aebdeac3-5882-4483-800c-0ccee4bacafb tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:29.250818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-aebdeac3-5882-4483-800c-0ccee4bacafb tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1513 microversion: 2.1 time: 0.161964 Jul 28 18:07:29.251397 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 351/690] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:29 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:30.272493 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3e1a27f7-6898-4c91-84c7-003628625ca7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:30.273471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3e1a27f7-6898-4c91-84c7-003628625ca7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:30.280174 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3e1a27f7-6898-4c91-84c7-003628625ca7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:30.280730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3e1a27f7-6898-4c91-84c7-003628625ca7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:30.281482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3e1a27f7-6898-4c91-84c7-003628625ca7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:30.281912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3e1a27f7-6898-4c91-84c7-003628625ca7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:30.410257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-3e1a27f7-6898-4c91-84c7-003628625ca7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:30.417862 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3e1a27f7-6898-4c91-84c7-003628625ca7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1513 microversion: 2.1 time: 0.149631 Jul 28 18:07:30.418531 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 340/691] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:30 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:31.439023 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e4268d95-830d-4666-8115-7d13e861f044 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:31.439634 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e4268d95-830d-4666-8115-7d13e861f044 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:31.446036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e4268d95-830d-4666-8115-7d13e861f044 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:31.446529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e4268d95-830d-4666-8115-7d13e861f044 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:31.447289 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e4268d95-830d-4666-8115-7d13e861f044 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:31.447724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e4268d95-830d-4666-8115-7d13e861f044 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:31.669491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e4268d95-830d-4666-8115-7d13e861f044 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:31.677733 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e4268d95-830d-4666-8115-7d13e861f044 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1513 microversion: 2.1 time: 0.243234 Jul 28 18:07:31.678303 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 352/692] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:31 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:32.134943 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-66e299fb-ac19-4089-8f44-7aae68eb4f63 req-4a2008b5-0142-42af-822b-b02bd8f8dd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb343d5-d21e-4542-a9b9-699415dbbb36", "name": "network-vif-deleted", "tag": "fe531d4b-eb49-4238-84c1-95c99ca13d2c"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:32.145953 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-66e299fb-ac19-4089-8f44-7aae68eb4f63 req-4a2008b5-0142-42af-822b-b02bd8f8dd83 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:32.146418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-66e299fb-ac19-4089-8f44-7aae68eb4f63 req-4a2008b5-0142-42af-822b-b02bd8f8dd83 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:32.158746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-66e299fb-ac19-4089-8f44-7aae68eb4f63 req-4a2008b5-0142-42af-822b-b02bd8f8dd83 service nova] Creating event network-vif-deleted:fe531d4b-eb49-4238-84c1-95c99ca13d2c for instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 on hv-cinder-83754 Jul 28 18:07:32.163676 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-66e299fb-ac19-4089-8f44-7aae68eb4f63 req-4a2008b5-0142-42af-822b-b02bd8f8dd83 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093727 Jul 28 18:07:32.164482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 341/693] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:07:32.699522 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:32.700108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:32.707305 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:32.707776 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:32.708550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:32.708977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:32.740384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:32.740819 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:32.741256 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lazy-loading 'fault' on Instance uuid 4eb343d5-d21e-4542-a9b9-699415dbbb36 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:07:32.782435 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:32.789851 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d1720f6b-087c-4671-93ba-0ed8d26e69dd tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 200 len: 1309 microversion: 2.1 time: 0.094590 Jul 28 18:07:32.790434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 353/694] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:32 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:33.812200 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:33.812820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4eb343d5-d21e-4542-a9b9-699415dbbb36] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:33.819487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:33.819939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:33.820707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:33.821148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:33.835458 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] HTTP exception thrown: Instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 could not be found. Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Request method failure captured: Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 HTTP/1.1 Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tAHUKmYSsL-ChNNO1GXUUSUSBi9ngD-NVtOQPUOWwwaYkD6KS-PI93NifV_svkOYV9lvogb97Xc-EgYh8Jw1fkSsUkHrbf8K2LPdZ4bRbDAWwNsNp2d3d0ApKu130ZM8gpopjrABKTIsn7kHJL5Hr_TzWFqH-8IEGdNBTkgBkDLDas Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 613c6d4f37814a209077ac2c19506674 Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1669713520 Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:07:33.837271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/613c6d4f37814a209077ac2c19506674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_613c6d4f37814a209077ac2c19506674", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/613c6d4f37814a209077ac2c19506674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/613c6d4f37814a209077ac2c19506674"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-VolumesSnapshotTestJSON-1669713520 Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 613c6d4f37814a209077ac2c19506674 Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1669713520 Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-VolumesSnapshotTestJSON-1669713520-project Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: aa7941170fe74f9c818f4ab612fca33f Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-VolumesSnapshotTestJSON-1669713520-project Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 could not be found. Jul 28 18:07:33.839050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '4eb343d5-d21e-4542-a9b9-699415dbbb36'} Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 could not be found. Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:07:33.840025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 could not be found. Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 could not be found. Jul 28 18:07:33.841437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:33.843710 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Returning 404 to user: Instance 4eb343d5-d21e-4542-a9b9-699415dbbb36 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:07:33.843710 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4945ccb6-5fab-4bcc-bf45-eff2841cc29d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36" status: 404 len: 111 microversion: 2.1 time: 0.031928 Jul 28 18:07:33.843710 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 342/695] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:33 2022] GET /compute/v2.1/servers/4eb343d5-d21e-4542-a9b9-699415dbbb36 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:07:38.022521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1d0278cb-529b-4ec7-b74c-c75860f102d8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-386670491"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:38.023110 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1d0278cb-529b-4ec7-b74c-c75860f102d8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:38.029261 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1d0278cb-529b-4ec7-b74c-c75860f102d8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:38.029773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1d0278cb-529b-4ec7-b74c-c75860f102d8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:38.030865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1d0278cb-529b-4ec7-b74c-c75860f102d8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:38.031307 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1d0278cb-529b-4ec7-b74c-c75860f102d8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:38.158234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.network.security_group_api [None req-1d0278cb-529b-4ec7-b74c-c75860f102d8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Removing security group ee8d2197-d7cb-4353-9736-921a854afbcd from port f808f4a9-93f4-4595-be63-aba89386ee2a Jul 28 18:07:38.843431 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1d0278cb-529b-4ec7-b74c-c75860f102d8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "POST /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/action" status: 202 len: 0 microversion: 2.1 time: 0.824120 Jul 28 18:07:38.848739 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 354/696] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:07:38 2022] POST /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:07:38.868008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-146ad42e-474e-4680-bdad-e78d6299098d req-5d40f674-4490-48d1-addd-42e9f2d66d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417aa872-dcc4-4460-99fb-d48819d6eead", "tag": "f808f4a9-93f4-4595-be63-aba89386ee2a"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:38.893312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-146ad42e-474e-4680-bdad-e78d6299098d req-5d40f674-4490-48d1-addd-42e9f2d66d0e service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:38.901619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-146ad42e-474e-4680-bdad-e78d6299098d req-5d40f674-4490-48d1-addd-42e9f2d66d0e service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:38.929577 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-146ad42e-474e-4680-bdad-e78d6299098d req-5d40f674-4490-48d1-addd-42e9f2d66d0e service nova] Creating event network-changed:f808f4a9-93f4-4595-be63-aba89386ee2a for instance 417aa872-dcc4-4460-99fb-d48819d6eead on hv-cinder-83754 Jul 28 18:07:38.940624 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-146ad42e-474e-4680-bdad-e78d6299098d req-5d40f674-4490-48d1-addd-42e9f2d66d0e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091036 Jul 28 18:07:38.941592 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 343/697] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:07:40.417358 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e395aa5b-4efc-470c-a831-a6c929ee42ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:40.422363 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e395aa5b-4efc-470c-a831-a6c929ee42ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:40.424348 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e395aa5b-4efc-470c-a831-a6c929ee42ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:40.424977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e395aa5b-4efc-470c-a831-a6c929ee42ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:40.425924 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e395aa5b-4efc-470c-a831-a6c929ee42ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:40.426386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e395aa5b-4efc-470c-a831-a6c929ee42ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:40.511318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-e395aa5b-4efc-470c-a831-a6c929ee42ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lazy-loading 'services' on Instance uuid 417aa872-dcc4-4460-99fb-d48819d6eead {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:07:40.727300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e395aa5b-4efc-470c-a831-a6c929ee42ac tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "DELETE /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments/525ac05d-0d55-445c-8094-4acb508d7aed" status: 202 len: 0 microversion: 2.1 time: 0.314223 Jul 28 18:07:40.729962 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 355/698] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:07:40 2022] DELETE /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments/525ac05d-0d55-445c-8094-4acb508d7aed => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:07:40.737834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1e516e46-b0e5-4878-8355-8afa98bbe21c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:40.740525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1e516e46-b0e5-4878-8355-8afa98bbe21c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:40.747903 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1e516e46-b0e5-4878-8355-8afa98bbe21c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:40.748529 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1e516e46-b0e5-4878-8355-8afa98bbe21c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:40.749584 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1e516e46-b0e5-4878-8355-8afa98bbe21c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:40.750096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1e516e46-b0e5-4878-8355-8afa98bbe21c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:40.780982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1e516e46-b0e5-4878-8355-8afa98bbe21c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048254 Jul 28 18:07:40.781644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 344/699] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:07:40 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:07:40.957492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-7abf1691-9755-420c-a702-3446df02fff3 req-02443131-cc64-44d5-b875-76a20a3ccfbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417aa872-dcc4-4460-99fb-d48819d6eead", "tag": "f808f4a9-93f4-4595-be63-aba89386ee2a"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:40.968144 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-7abf1691-9755-420c-a702-3446df02fff3 req-02443131-cc64-44d5-b875-76a20a3ccfbf service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:40.968515 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-7abf1691-9755-420c-a702-3446df02fff3 req-02443131-cc64-44d5-b875-76a20a3ccfbf service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:40.979709 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-7abf1691-9755-420c-a702-3446df02fff3 req-02443131-cc64-44d5-b875-76a20a3ccfbf service nova] Creating event network-changed:f808f4a9-93f4-4595-be63-aba89386ee2a for instance 417aa872-dcc4-4460-99fb-d48819d6eead on hv-cinder-83754 Jul 28 18:07:40.985911 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-7abf1691-9755-420c-a702-3446df02fff3 req-02443131-cc64-44d5-b875-76a20a3ccfbf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 Jul 28 18:07:40.986645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 356/700] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:41.794017 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fb7ebcaf-6426-4a49-8fd4-1341d475ff8a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:41.796475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-fb7ebcaf-6426-4a49-8fd4-1341d475ff8a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:41.803024 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fb7ebcaf-6426-4a49-8fd4-1341d475ff8a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:41.803477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fb7ebcaf-6426-4a49-8fd4-1341d475ff8a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:41.804246 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fb7ebcaf-6426-4a49-8fd4-1341d475ff8a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:41.804685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fb7ebcaf-6426-4a49-8fd4-1341d475ff8a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:41.834612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fb7ebcaf-6426-4a49-8fd4-1341d475ff8a tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045158 Jul 28 18:07:41.835245 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 345/701] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:07:41 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:42.848831 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b59cc1dc-9934-491a-93cf-f3e015ad5422 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:42.851111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b59cc1dc-9934-491a-93cf-f3e015ad5422 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:42.857346 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b59cc1dc-9934-491a-93cf-f3e015ad5422 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:42.857796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b59cc1dc-9934-491a-93cf-f3e015ad5422 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:42.858857 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b59cc1dc-9934-491a-93cf-f3e015ad5422 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:42.859290 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b59cc1dc-9934-491a-93cf-f3e015ad5422 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:42.887530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b59cc1dc-9934-491a-93cf-f3e015ad5422 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Jul 28 18:07:42.888087 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 357/702] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:07:42 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:43.900599 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-957bff1c-cdc8-417b-bf33-28732ff0f54c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:43.902818 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-957bff1c-cdc8-417b-bf33-28732ff0f54c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:43.910269 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-957bff1c-cdc8-417b-bf33-28732ff0f54c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:43.912658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-957bff1c-cdc8-417b-bf33-28732ff0f54c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:43.912658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-957bff1c-cdc8-417b-bf33-28732ff0f54c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:43.912658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-957bff1c-cdc8-417b-bf33-28732ff0f54c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:43.946070 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-957bff1c-cdc8-417b-bf33-28732ff0f54c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049838 Jul 28 18:07:43.947244 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 346/703] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:07:43 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:44.656692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1038538179", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "networks": [{"uuid": "01c55f50-a315-477f-80d3-c30431bfaa68"}]}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:44.713087 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] validate_networks() for [('01c55f50-a315-477f-80d3-c30431bfaa68', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:07:44.958575 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f24b597d-323e-42fe-b887-82d9288289e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:44.961459 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f24b597d-323e-42fe-b887-82d9288289e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:44.969225 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f24b597d-323e-42fe-b887-82d9288289e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:44.969754 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f24b597d-323e-42fe-b887-82d9288289e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:44.971653 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f24b597d-323e-42fe-b887-82d9288289e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:44.973118 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f24b597d-323e-42fe-b887-82d9288289e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:45.005699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f24b597d-323e-42fe-b887-82d9288289e0 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051261 Jul 28 18:07:45.006260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 347/704] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:07:44 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:07:45.017133 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:45.017632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:45.023786 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:45.024374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:45.025161 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:45.025603 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:45.117135 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:07:45.117556 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:07:45.118030 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:07:45.118469 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:07:45.118912 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:07:45.128896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:45.129341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:45.130166 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:45.130632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:45.147327 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Getting quotas for project 613c6d4f37814a209077ac2c19506674. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:07:45.148791 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] HTTP exception thrown: Instance 417aa872-dcc4-4460-99fb-d48819d6eead is not attached to volume 525ac05d-0d55-445c-8094-4acb508d7aed Jul 28 18:07:45.151544 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Getting quotas for user aa7941170fe74f9c818f4ab612fca33f and project 613c6d4f37814a209077ac2c19506674. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Request method failure captured: Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments/525ac05d-0d55-445c-8094-4acb508d7aed HTTP/1.1 Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s-PdScFVWEUd_LZZKdrjXEqtEDn1AMUv2TfX7zzi8kJrdyt9RWbnyYNwnrvEEK5VNP9kurUFn2HBmriIwks82-JpgqAysrrv5ZRnwPIz5KiiUOBktVeWCxWJ-a6hAkumMMVUpAN1t3NNzEyR4yJgGBXe8tiwf5C4xLGDlWURITgDzQ Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 39115160ca364b2590af12fccde98256 Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-TestMinimumBasicScenario-211670379 Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:07:45.162920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/39115160ca364b2590af12fccde98256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_39115160ca364b2590af12fccde98256", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/39115160ca364b2590af12fccde98256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/39115160ca364b2590af12fccde98256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-TestMinimumBasicScenario-211670379 Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 39115160ca364b2590af12fccde98256 Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-TestMinimumBasicScenario-211670379 Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-TestMinimumBasicScenario-211670379-project Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 78888cc145ba4052be05b1c321de44fd Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-TestMinimumBasicScenario-211670379-project Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:07:45.164305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 417aa872-dcc4-4460-99fb-d48819d6eead is not attached to volume 525ac05d-0d55-445c-8094-4acb508d7aed Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'server_id': '417aa872-dcc4-4460-99fb-d48819d6eead', 'id': '525ac05d-0d55-445c-8094-4acb508d7aed'} Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 525ac05d-0d55-445c-8094-4acb508d7aed. Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:07:45.165170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417aa872-dcc4-4460-99fb-d48819d6eead is not attached to volume 525ac05d-0d55-445c-8094-4acb508d7aed Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417aa872-dcc4-4460-99fb-d48819d6eead is not attached to volume 525ac05d-0d55-445c-8094-4acb508d7aed Jul 28 18:07:45.166532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:07:45.167360 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:07:45.167440 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Returning 404 to user: Instance 417aa872-dcc4-4460-99fb-d48819d6eead is not attached to volume 525ac05d-0d55-445c-8094-4acb508d7aed {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:07:45.167440 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e7b22bb3-adc3-4c24-ab6d-485c05210ae2 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "DELETE /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments/525ac05d-0d55-445c-8094-4acb508d7aed" status: 404 len: 154 microversion: 2.1 time: 0.152103 Jul 28 18:07:45.167596 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:07:45.167689 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 348/705] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:07:45 2022] DELETE /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead/os-volume_attachments/525ac05d-0d55-445c-8094-4acb508d7aed => generated 154 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:07:45.308750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e54a3c3c-4179-4e5f-ad85-7a2ca31cdc4b tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657461 Jul 28 18:07:45.309401 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 358/706] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:07:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:07:45.320338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-71ccedc6-5881-4f4f-9420-441a09414c01 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:45.320949 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-71ccedc6-5881-4f4f-9420-441a09414c01 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:45.380793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-71ccedc6-5881-4f4f-9420-441a09414c01 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:45.391211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-71ccedc6-5881-4f4f-9420-441a09414c01 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1219 microversion: 2.1 time: 0.072972 Jul 28 18:07:45.391211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 349/707] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:45 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:46.416400 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-66d658d7-dbd4-4da8-9c8a-3fdb4ada46d8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:46.416997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-66d658d7-dbd4-4da8-9c8a-3fdb4ada46d8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:46.424139 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-66d658d7-dbd4-4da8-9c8a-3fdb4ada46d8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:46.424579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-66d658d7-dbd4-4da8-9c8a-3fdb4ada46d8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:46.427750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-66d658d7-dbd4-4da8-9c8a-3fdb4ada46d8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:46.427750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-66d658d7-dbd4-4da8-9c8a-3fdb4ada46d8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:46.476356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e5d27a10-42ad-4d20-b5b6-06ce9835f841 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:46.476958 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e5d27a10-42ad-4d20-b5b6-06ce9835f841 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:46.484532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5d27a10-42ad-4d20-b5b6-06ce9835f841 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:46.484933 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5d27a10-42ad-4d20-b5b6-06ce9835f841 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:46.485762 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5d27a10-42ad-4d20-b5b6-06ce9835f841 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:46.486207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5d27a10-42ad-4d20-b5b6-06ce9835f841 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:46.493391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-66d658d7-dbd4-4da8-9c8a-3fdb4ada46d8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:46.502518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-66d658d7-dbd4-4da8-9c8a-3fdb4ada46d8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1223 microversion: 2.1 time: 0.090281 Jul 28 18:07:46.503098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 359/708] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:46 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:46.513598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e5d27a10-42ad-4d20-b5b6-06ce9835f841 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:07:47.003129 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e5d27a10-42ad-4d20-b5b6-06ce9835f841 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "DELETE /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 204 len: 0 microversion: 2.1 time: 0.530528 Jul 28 18:07:47.005000 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 350/709] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:07:46 2022] DELETE /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:07:47.014476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-343e1876-1da7-4a8a-abfd-8e41cb399ca8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:47.014476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-343e1876-1da7-4a8a-abfd-8e41cb399ca8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:47.018773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-343e1876-1da7-4a8a-abfd-8e41cb399ca8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:47.019224 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-343e1876-1da7-4a8a-abfd-8e41cb399ca8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:47.019991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-343e1876-1da7-4a8a-abfd-8e41cb399ca8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:47.020427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-343e1876-1da7-4a8a-abfd-8e41cb399ca8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:47.151412 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-343e1876-1da7-4a8a-abfd-8e41cb399ca8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:47.159766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-343e1876-1da7-4a8a-abfd-8e41cb399ca8 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1554 microversion: 2.1 time: 0.151488 Jul 28 18:07:47.160319 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 360/710] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:47 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:47.523192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-60e0b1b0-b8c6-48d5-ae26-cf0999dc0b59 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:47.523882 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-60e0b1b0-b8c6-48d5-ae26-cf0999dc0b59 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:47.530333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60e0b1b0-b8c6-48d5-ae26-cf0999dc0b59 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:47.530799 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60e0b1b0-b8c6-48d5-ae26-cf0999dc0b59 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:47.531548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60e0b1b0-b8c6-48d5-ae26-cf0999dc0b59 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:47.531980 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60e0b1b0-b8c6-48d5-ae26-cf0999dc0b59 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:47.594716 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-60e0b1b0-b8c6-48d5-ae26-cf0999dc0b59 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:47.602083 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-60e0b1b0-b8c6-48d5-ae26-cf0999dc0b59 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1215 microversion: 2.1 time: 0.083081 Jul 28 18:07:47.602667 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 351/711] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:47 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:48.181331 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2b0de5eb-a4bc-4431-b124-5c3b57eb241c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:48.181913 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2b0de5eb-a4bc-4431-b124-5c3b57eb241c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:48.189541 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2b0de5eb-a4bc-4431-b124-5c3b57eb241c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:48.189977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2b0de5eb-a4bc-4431-b124-5c3b57eb241c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:48.190770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2b0de5eb-a4bc-4431-b124-5c3b57eb241c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:48.191197 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2b0de5eb-a4bc-4431-b124-5c3b57eb241c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:48.331123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2b0de5eb-a4bc-4431-b124-5c3b57eb241c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:48.338716 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2b0de5eb-a4bc-4431-b124-5c3b57eb241c tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1554 microversion: 2.1 time: 0.161232 Jul 28 18:07:48.339330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 361/712] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:48 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:48.625067 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ad5e2ee3-05dd-4be4-b26e-88abb23b64b8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:48.625649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ad5e2ee3-05dd-4be4-b26e-88abb23b64b8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:48.632538 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad5e2ee3-05dd-4be4-b26e-88abb23b64b8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:48.632984 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad5e2ee3-05dd-4be4-b26e-88abb23b64b8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:48.633744 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad5e2ee3-05dd-4be4-b26e-88abb23b64b8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:48.634239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad5e2ee3-05dd-4be4-b26e-88abb23b64b8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:48.697762 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ad5e2ee3-05dd-4be4-b26e-88abb23b64b8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:48.705729 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ad5e2ee3-05dd-4be4-b26e-88abb23b64b8 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1215 microversion: 2.1 time: 0.086144 Jul 28 18:07:48.706284 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 352/713] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:48 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:07:49.361615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-057d7d3b-0dbe-4110-86b0-74c3c3fad874 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:49.362233 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-057d7d3b-0dbe-4110-86b0-74c3c3fad874 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:49.369580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-057d7d3b-0dbe-4110-86b0-74c3c3fad874 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:49.369769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-057d7d3b-0dbe-4110-86b0-74c3c3fad874 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:49.370428 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-057d7d3b-0dbe-4110-86b0-74c3c3fad874 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:49.370864 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-057d7d3b-0dbe-4110-86b0-74c3c3fad874 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:49.508800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-057d7d3b-0dbe-4110-86b0-74c3c3fad874 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:49.517091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-057d7d3b-0dbe-4110-86b0-74c3c3fad874 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1554 microversion: 2.1 time: 0.159831 Jul 28 18:07:49.518477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 362/714] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:49 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:49.726742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0861b3ce-329b-42d2-abd7-cc3a61853b38 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:49.728028 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0861b3ce-329b-42d2-abd7-cc3a61853b38 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:49.735699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0861b3ce-329b-42d2-abd7-cc3a61853b38 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:49.736427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0861b3ce-329b-42d2-abd7-cc3a61853b38 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:49.737409 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0861b3ce-329b-42d2-abd7-cc3a61853b38 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:49.738037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0861b3ce-329b-42d2-abd7-cc3a61853b38 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:49.830206 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0861b3ce-329b-42d2-abd7-cc3a61853b38 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:49.838864 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0861b3ce-329b-42d2-abd7-cc3a61853b38 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1279 microversion: 2.1 time: 0.116222 Jul 28 18:07:49.842920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 353/715] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:49 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:50.433806 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-20486dc9-7f7a-4b40-ad15-49bed651820b req-eaf7d22a-177d-45b1-8064-f0081c3648c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417aa872-dcc4-4460-99fb-d48819d6eead", "name": "network-vif-deleted", "tag": "f808f4a9-93f4-4595-be63-aba89386ee2a"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:50.444451 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-20486dc9-7f7a-4b40-ad15-49bed651820b req-eaf7d22a-177d-45b1-8064-f0081c3648c7 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:50.444888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-20486dc9-7f7a-4b40-ad15-49bed651820b req-eaf7d22a-177d-45b1-8064-f0081c3648c7 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:50.456815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-20486dc9-7f7a-4b40-ad15-49bed651820b req-eaf7d22a-177d-45b1-8064-f0081c3648c7 service nova] Creating event network-vif-deleted:f808f4a9-93f4-4595-be63-aba89386ee2a for instance 417aa872-dcc4-4460-99fb-d48819d6eead on hv-cinder-83754 Jul 28 18:07:50.462136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-20486dc9-7f7a-4b40-ad15-49bed651820b req-eaf7d22a-177d-45b1-8064-f0081c3648c7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Jul 28 18:07:50.462842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 363/716] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:50.539094 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3a91eee0-5258-4d22-bc87-58577244d44d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:50.539706 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3a91eee0-5258-4d22-bc87-58577244d44d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:50.546932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3a91eee0-5258-4d22-bc87-58577244d44d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:50.547395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3a91eee0-5258-4d22-bc87-58577244d44d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:50.548182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3a91eee0-5258-4d22-bc87-58577244d44d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:50.548831 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3a91eee0-5258-4d22-bc87-58577244d44d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:50.623938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-3a91eee0-5258-4d22-bc87-58577244d44d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78888cc145ba4052be05b1c321de44fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39115160ca364b2590af12fccde98256', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:50.632811 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3a91eee0-5258-4d22-bc87-58577244d44d tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 200 len: 1512 microversion: 2.1 time: 0.097457 Jul 28 18:07:50.633311 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 354/717] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:50 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 1512 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:50.870020 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3265e5fc-cd5c-4005-9c60-b36136420213 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:50.870738 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3265e5fc-cd5c-4005-9c60-b36136420213 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:50.877092 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3265e5fc-cd5c-4005-9c60-b36136420213 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:50.877547 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3265e5fc-cd5c-4005-9c60-b36136420213 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:50.878372 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3265e5fc-cd5c-4005-9c60-b36136420213 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:50.878814 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3265e5fc-cd5c-4005-9c60-b36136420213 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:51.014972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3265e5fc-cd5c-4005-9c60-b36136420213 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:51.023808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3265e5fc-cd5c-4005-9c60-b36136420213 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.158344 Jul 28 18:07:51.024366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 364/718] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:50 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:51.654430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:51.655882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] [instance: 417aa872-dcc4-4460-99fb-d48819d6eead] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:51.662486 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:51.663155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:51.664131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:51.664729 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:51.683172 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-572659c8-ca71-4d51-94a0-0a3ca6473d35 req-f67c0347-c2db-4655-86ad-b81e6996361d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ad828ea-8b73-4f24-aa97-acb56da85c39", "tag": "79345ca0-155b-4b17-bb3b-13344d9bcff1"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:51.684796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] HTTP exception thrown: Instance 417aa872-dcc4-4460-99fb-d48819d6eead could not be found. Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Request method failure captured: Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead HTTP/1.1 Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s-PdScFVWEUd_LZZKdrjXEqtEDn1AMUv2TfX7zzi8kJrdyt9RWbnyYNwnrvEEK5VNP9kurUFn2HBmriIwks82-JpgqAysrrv5ZRnwPIz5KiiUOBktVeWCxWJ-a6hAkumMMVUpAN1t3NNzEyR4yJgGBXe8tiwf5C4xLGDlWURITgDzQ Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 39115160ca364b2590af12fccde98256 Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-TestMinimumBasicScenario-211670379 Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:07:51.686926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/39115160ca364b2590af12fccde98256"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_39115160ca364b2590af12fccde98256", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/39115160ca364b2590af12fccde98256"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/39115160ca364b2590af12fccde98256"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-TestMinimumBasicScenario-211670379 Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 39115160ca364b2590af12fccde98256 Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-TestMinimumBasicScenario-211670379 Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-TestMinimumBasicScenario-211670379-project Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 78888cc145ba4052be05b1c321de44fd Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-TestMinimumBasicScenario-211670379-project Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 417aa872-dcc4-4460-99fb-d48819d6eead could not be found. Jul 28 18:07:51.688557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '417aa872-dcc4-4460-99fb-d48819d6eead'} Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417aa872-dcc4-4460-99fb-d48819d6eead could not be found. Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:07:51.689366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417aa872-dcc4-4460-99fb-d48819d6eead could not be found. Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417aa872-dcc4-4460-99fb-d48819d6eead could not be found. Jul 28 18:07:51.690823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:07:51.692216 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Returning 404 to user: Instance 417aa872-dcc4-4460-99fb-d48819d6eead could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:07:51.692216 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ff6becd4-de9c-4d60-93fd-4a8e51af2777 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead" status: 404 len: 111 microversion: 2.1 time: 0.037896 Jul 28 18:07:51.692216 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 365/719] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:51 2022] GET /compute/v2.1/servers/417aa872-dcc4-4460-99fb-d48819d6eead => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:07:51.693444 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-572659c8-ca71-4d51-94a0-0a3ca6473d35 req-f67c0347-c2db-4655-86ad-b81e6996361d service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:51.693901 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-572659c8-ca71-4d51-94a0-0a3ca6473d35 req-f67c0347-c2db-4655-86ad-b81e6996361d service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:51.697153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ed7d9453-aa83-4960-9215-011aaf321f76 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] Calling method '.version_select at 0x7fdae02e9430>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:51.705425 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:51.707377 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-572659c8-ca71-4d51-94a0-0a3ca6473d35 req-f67c0347-c2db-4655-86ad-b81e6996361d service nova] Creating event network-changed:79345ca0-155b-4b17-bb3b-13344d9bcff1 for instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 on hv-cinder-83754 Jul 28 18:07:51.712480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-572659c8-ca71-4d51-94a0-0a3ca6473d35 req-f67c0347-c2db-4655-86ad-b81e6996361d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091363 Jul 28 18:07:51.712766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 355/720] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:07:51.827284 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ed7d9453-aa83-4960-9215-011aaf321f76 tempest-TestMinimumBasicScenario-211670379 tempest-TestMinimumBasicScenario-211670379-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1321978075" status: 202 len: 0 microversion: 2.1 time: 0.133172 Jul 28 18:07:51.828018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 366/721] 10.222.0.85 () {58 vars in 1272 bytes} [Thu Jul 28 18:07:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1321978075 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:07:52.046419 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8d634093-5202-4d8e-b9a0-01d3c37feaef tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:52.047121 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8d634093-5202-4d8e-b9a0-01d3c37feaef tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:52.054164 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8d634093-5202-4d8e-b9a0-01d3c37feaef tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:52.055890 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8d634093-5202-4d8e-b9a0-01d3c37feaef tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:52.055890 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8d634093-5202-4d8e-b9a0-01d3c37feaef tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:52.055890 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8d634093-5202-4d8e-b9a0-01d3c37feaef tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:52.236122 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8d634093-5202-4d8e-b9a0-01d3c37feaef tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:52.241549 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8d634093-5202-4d8e-b9a0-01d3c37feaef tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.199480 Jul 28 18:07:52.242122 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 356/722] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:52 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:53.263396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5ddfe71f-b767-4851-b463-75d29585475d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:53.264066 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5ddfe71f-b767-4851-b463-75d29585475d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:53.270880 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5ddfe71f-b767-4851-b463-75d29585475d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:53.271323 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5ddfe71f-b767-4851-b463-75d29585475d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:53.272080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5ddfe71f-b767-4851-b463-75d29585475d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:53.272511 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5ddfe71f-b767-4851-b463-75d29585475d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:53.502105 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5ddfe71f-b767-4851-b463-75d29585475d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:53.509563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5ddfe71f-b767-4851-b463-75d29585475d tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.250535 Jul 28 18:07:53.510468 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 367/723] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:53 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:54.535591 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-44e74063-c634-4385-aeac-4ca16a7ddc04 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:54.536252 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-44e74063-c634-4385-aeac-4ca16a7ddc04 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:54.544688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44e74063-c634-4385-aeac-4ca16a7ddc04 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:54.546198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44e74063-c634-4385-aeac-4ca16a7ddc04 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:54.547640 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44e74063-c634-4385-aeac-4ca16a7ddc04 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:54.548712 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44e74063-c634-4385-aeac-4ca16a7ddc04 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:54.714156 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-44e74063-c634-4385-aeac-4ca16a7ddc04 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:54.721983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-44e74063-c634-4385-aeac-4ca16a7ddc04 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.192795 Jul 28 18:07:54.722579 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 357/724] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:54 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:55.744096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-11d6104b-17ad-45c1-818c-35c4975653db tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:55.745808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-11d6104b-17ad-45c1-818c-35c4975653db tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:55.752355 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:55.753033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=6 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:55.755294 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11d6104b-17ad-45c1-818c-35c4975653db tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:55.755746 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11d6104b-17ad-45c1-818c-35c4975653db tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:55.756177 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c5f92be3-ec14-4f60-86b2-1c27904f77c4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:55.756679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11d6104b-17ad-45c1-818c-35c4975653db tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:55.756776 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c5f92be3-ec14-4f60-86b2-1c27904f77c4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:55.756966 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11d6104b-17ad-45c1-818c-35c4975653db tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:55.762125 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:55.767147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c5f92be3-ec14-4f60-86b2-1c27904f77c4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:55.767147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c5f92be3-ec14-4f60-86b2-1c27904f77c4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:55.767147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c5f92be3-ec14-4f60-86b2-1c27904f77c4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:55.767147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c5f92be3-ec14-4f60-86b2-1c27904f77c4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:55.877101 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-c5f92be3-ec14-4f60-86b2-1c27904f77c4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'services' on Instance uuid 07dd071c-f443-4fbc-a37c-0b8b250968a4 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:07:55.987034 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-11d6104b-17ad-45c1-818c-35c4975653db tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:55.994885 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:56.001122 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-11d6104b-17ad-45c1-818c-35c4975653db tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.261008 Jul 28 18:07:56.002039 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 368/725] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:55 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:56.196408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c5f92be3-ec14-4f60-86b2-1c27904f77c4 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "DELETE /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments/722a33d4-f760-494c-88c8-753c03acc0b8" status: 202 len: 0 microversion: 2.1 time: 0.444036 Jul 28 18:07:56.197766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 358/726] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:07:55 2022] DELETE /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments/722a33d4-f760-494c-88c8-753c03acc0b8 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:07:56.206277 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b809110b-790f-4252-8d5d-4bbb878abd0b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:56.208685 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b809110b-790f-4252-8d5d-4bbb878abd0b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:56.215636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b809110b-790f-4252-8d5d-4bbb878abd0b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:56.216083 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b809110b-790f-4252-8d5d-4bbb878abd0b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:56.217909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b809110b-790f-4252-8d5d-4bbb878abd0b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:56.218584 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b809110b-790f-4252-8d5d-4bbb878abd0b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:56.249754 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b809110b-790f-4252-8d5d-4bbb878abd0b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047457 Jul 28 18:07:56.250548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 369/727] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:07:56 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:57.024351 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ec204aaf-99be-45aa-aa2b-098e7a5c25a0 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:57.025150 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ec204aaf-99be-45aa-aa2b-098e7a5c25a0 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:57.033073 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ec204aaf-99be-45aa-aa2b-098e7a5c25a0 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:57.034381 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ec204aaf-99be-45aa-aa2b-098e7a5c25a0 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:57.034658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ec204aaf-99be-45aa-aa2b-098e7a5c25a0 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:57.035271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ec204aaf-99be-45aa-aa2b-098e7a5c25a0 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:57.194258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ec204aaf-99be-45aa-aa2b-098e7a5c25a0 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:57.203913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ec204aaf-99be-45aa-aa2b-098e7a5c25a0 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.184354 Jul 28 18:07:57.204857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 359/728] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:57 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:57.263386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b4e6f8e8-7273-4cde-935b-984fa3929f0e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:57.266538 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b4e6f8e8-7273-4cde-935b-984fa3929f0e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:57.270173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:57.281137 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b4e6f8e8-7273-4cde-935b-984fa3929f0e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:57.281585 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b4e6f8e8-7273-4cde-935b-984fa3929f0e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:57.282663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b4e6f8e8-7273-4cde-935b-984fa3929f0e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:57.283101 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b4e6f8e8-7273-4cde-935b-984fa3929f0e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:57.314124 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b4e6f8e8-7273-4cde-935b-984fa3929f0e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055729 Jul 28 18:07:57.314737 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 370/729] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:07:57 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:58.081216 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-b42786ff-8186-45cf-9a41-f9e7e1cf21f3 req-5590099f-3336-447d-835c-03aafd34eb18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad828ea-8b73-4f24-aa97-acb56da85c39", "name": "network-vif-plugged", "status": "completed", "tag": "79345ca0-155b-4b17-bb3b-13344d9bcff1"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:07:58.091285 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-b42786ff-8186-45cf-9a41-f9e7e1cf21f3 req-5590099f-3336-447d-835c-03aafd34eb18 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.092367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-b42786ff-8186-45cf-9a41-f9e7e1cf21f3 req-5590099f-3336-447d-835c-03aafd34eb18 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.103575 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-b42786ff-8186-45cf-9a41-f9e7e1cf21f3 req-5590099f-3336-447d-835c-03aafd34eb18 service nova] Creating event network-vif-plugged:79345ca0-155b-4b17-bb3b-13344d9bcff1 for instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 on hv-cinder-83754 Jul 28 18:07:58.109734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-b42786ff-8186-45cf-9a41-f9e7e1cf21f3 req-5590099f-3336-447d-835c-03aafd34eb18 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091948 Jul 28 18:07:58.110398 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 360/730] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:07:58.226785 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a280f67a-8fbf-4cd8-b09d-db4618011c91 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:58.227442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a280f67a-8fbf-4cd8-b09d-db4618011c91 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:58.236245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a280f67a-8fbf-4cd8-b09d-db4618011c91 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.236681 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a280f67a-8fbf-4cd8-b09d-db4618011c91 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.237442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a280f67a-8fbf-4cd8-b09d-db4618011c91 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.237869 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a280f67a-8fbf-4cd8-b09d-db4618011c91 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.328166 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-078d866d-ee7b-4ecd-a518-cf91d9d96222 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:58.330666 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-078d866d-ee7b-4ecd-a518-cf91d9d96222 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:58.337405 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-078d866d-ee7b-4ecd-a518-cf91d9d96222 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.337891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-078d866d-ee7b-4ecd-a518-cf91d9d96222 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.338904 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-078d866d-ee7b-4ecd-a518-cf91d9d96222 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.339344 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-078d866d-ee7b-4ecd-a518-cf91d9d96222 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.370942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-078d866d-ee7b-4ecd-a518-cf91d9d96222 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048020 Jul 28 18:07:58.371518 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 361/731] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:07:58 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:07:58.390553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a280f67a-8fbf-4cd8-b09d-db4618011c91 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:58.400291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a280f67a-8fbf-4cd8-b09d-db4618011c91 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.177449 Jul 28 18:07:58.402928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 371/732] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:58 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:58.465543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-145536c5-86bb-42dd-b325-2786aadadccb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:58.466332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-145536c5-86bb-42dd-b325-2786aadadccb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:58.473336 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-145536c5-86bb-42dd-b325-2786aadadccb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.473813 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-145536c5-86bb-42dd-b325-2786aadadccb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.474632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-145536c5-86bb-42dd-b325-2786aadadccb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.475069 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-145536c5-86bb-42dd-b325-2786aadadccb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.501773 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-145536c5-86bb-42dd-b325-2786aadadccb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:07:58.570683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d4c23488-1823-41f9-a39a-963406aea2f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:58.571305 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d4c23488-1823-41f9-a39a-963406aea2f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:58.578118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d4c23488-1823-41f9-a39a-963406aea2f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.578559 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d4c23488-1823-41f9-a39a-963406aea2f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.579335 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d4c23488-1823-41f9-a39a-963406aea2f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.579768 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d4c23488-1823-41f9-a39a-963406aea2f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.605397 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d4c23488-1823-41f9-a39a-963406aea2f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/ips" status: 200 len: 151 microversion: 2.20 time: 0.039067 Jul 28 18:07:58.605972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 372/733] 10.222.0.85 () {60 vars in 1289 bytes} [Thu Jul 28 18:07:58 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:07:58.831173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-145536c5-86bb-42dd-b325-2786aadadccb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "DELETE /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 204 len: 0 microversion: 2.1 time: 0.369456 Jul 28 18:07:58.831783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 362/734] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:07:58 2022] DELETE /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:07:58.845354 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-aac50cf7-1001-402c-b16f-a061585579e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:58.845959 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-aac50cf7-1001-402c-b16f-a061585579e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:58.852079 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aac50cf7-1001-402c-b16f-a061585579e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.852530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aac50cf7-1001-402c-b16f-a061585579e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:58.853299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aac50cf7-1001-402c-b16f-a061585579e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:58.853734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aac50cf7-1001-402c-b16f-a061585579e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:59.019718 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-aac50cf7-1001-402c-b16f-a061585579e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:59.029715 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-aac50cf7-1001-402c-b16f-a061585579e9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1690 microversion: 2.1 time: 0.188310 Jul 28 18:07:59.033753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 373/735] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:58 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1690 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:07:59.424283 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-818ca5a2-363f-4694-81ea-ac63f7fb1536 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:07:59.425790 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-818ca5a2-363f-4694-81ea-ac63f7fb1536 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:07:59.428982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=3 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:07:59.433899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-818ca5a2-363f-4694-81ea-ac63f7fb1536 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:59.434643 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-818ca5a2-363f-4694-81ea-ac63f7fb1536 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:59.436147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-818ca5a2-363f-4694-81ea-ac63f7fb1536 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:07:59.436619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-818ca5a2-363f-4694-81ea-ac63f7fb1536 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:07:59.693711 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-818ca5a2-363f-4694-81ea-ac63f7fb1536 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:07:59.702202 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-818ca5a2-363f-4694-81ea-ac63f7fb1536 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.282386 Jul 28 18:07:59.703203 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 363/736] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:07:59 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:00.051555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6d050b17-f0bd-4fb6-a163-0db8148123eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:00.052859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6d050b17-f0bd-4fb6-a163-0db8148123eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:00.062799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d050b17-f0bd-4fb6-a163-0db8148123eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:00.068427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d050b17-f0bd-4fb6-a163-0db8148123eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:00.068427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d050b17-f0bd-4fb6-a163-0db8148123eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:00.068427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6d050b17-f0bd-4fb6-a163-0db8148123eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:00.204167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6d050b17-f0bd-4fb6-a163-0db8148123eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:00.212160 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6d050b17-f0bd-4fb6-a163-0db8148123eb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1690 microversion: 2.1 time: 0.164354 Jul 28 18:08:00.223336 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 374/737] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:00 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:00.729350 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-60039624-5acf-41c0-ad91-367fec98ac02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:00.730878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-60039624-5acf-41c0-ad91-367fec98ac02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:00.740040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60039624-5acf-41c0-ad91-367fec98ac02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:00.740586 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60039624-5acf-41c0-ad91-367fec98ac02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:00.741874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60039624-5acf-41c0-ad91-367fec98ac02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:00.742026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60039624-5acf-41c0-ad91-367fec98ac02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:01.148902 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-60039624-5acf-41c0-ad91-367fec98ac02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:01.158981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-60039624-5acf-41c0-ad91-367fec98ac02 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.434349 Jul 28 18:08:01.158981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 364/738] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:00 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:01.234107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d97cbd10-b97e-4db4-b0e9-7c714461fddc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:01.234890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d97cbd10-b97e-4db4-b0e9-7c714461fddc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:01.242330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d97cbd10-b97e-4db4-b0e9-7c714461fddc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:01.242799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d97cbd10-b97e-4db4-b0e9-7c714461fddc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:01.243628 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d97cbd10-b97e-4db4-b0e9-7c714461fddc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:01.244060 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d97cbd10-b97e-4db4-b0e9-7c714461fddc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:01.415926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d97cbd10-b97e-4db4-b0e9-7c714461fddc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:01.425456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d97cbd10-b97e-4db4-b0e9-7c714461fddc tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1690 microversion: 2.1 time: 0.195563 Jul 28 18:08:01.426543 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 375/739] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:01 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1690 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:01.977958 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b4d0d823-b58b-498e-a5eb-290de8a707ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:01.978529 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b4d0d823-b58b-498e-a5eb-290de8a707ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:01.987460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b4d0d823-b58b-498e-a5eb-290de8a707ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:01.987913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b4d0d823-b58b-498e-a5eb-290de8a707ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:01.988678 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b4d0d823-b58b-498e-a5eb-290de8a707ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:01.989110 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b4d0d823-b58b-498e-a5eb-290de8a707ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:02.012247 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-b4d0d823-b58b-498e-a5eb-290de8a707ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lazy-loading 'flavor' on Instance uuid b6ad8548-670a-4120-9652-2c63a78dd575 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:08:02.179137 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2747870d-f375-4b3c-9024-1f59f4dd396a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:02.179744 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2747870d-f375-4b3c-9024-1f59f4dd396a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:02.186133 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2747870d-f375-4b3c-9024-1f59f4dd396a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:02.186661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2747870d-f375-4b3c-9024-1f59f4dd396a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:02.189973 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2747870d-f375-4b3c-9024-1f59f4dd396a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:02.189973 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2747870d-f375-4b3c-9024-1f59f4dd396a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:02.331870 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2747870d-f375-4b3c-9024-1f59f4dd396a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:02.341002 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2747870d-f375-4b3c-9024-1f59f4dd396a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1319 microversion: 2.1 time: 0.165719 Jul 28 18:08:02.342334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 376/740] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:02 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:02.449776 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b4dae8a4-ae5e-45b4-aabc-1957c0eae0a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:02.450397 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b4dae8a4-ae5e-45b4-aabc-1957c0eae0a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:02.457106 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b4dae8a4-ae5e-45b4-aabc-1957c0eae0a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:02.463154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b4dae8a4-ae5e-45b4-aabc-1957c0eae0a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:02.463154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b4dae8a4-ae5e-45b4-aabc-1957c0eae0a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:02.463154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b4dae8a4-ae5e-45b4-aabc-1957c0eae0a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:02.555493 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b4d0d823-b58b-498e-a5eb-290de8a707ef tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/action" status: 202 len: 0 microversion: 2.20 time: 0.581169 Jul 28 18:08:02.556310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 365/741] 10.222.0.85 () {62 vars in 1319 bytes} [Thu Jul 28 18:08:01 2022] POST /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:08:02.565646 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:02.566672 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:02.572993 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:02.573439 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:02.574248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:02.574735 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:02.603898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b4dae8a4-ae5e-45b4-aabc-1957c0eae0a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:02.629443 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b4dae8a4-ae5e-45b4-aabc-1957c0eae0a9 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1690 microversion: 2.1 time: 0.166893 Jul 28 18:08:02.629443 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 377/742] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:02 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:02.735471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:02.744372 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:02.745845 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:02.747026 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2141466d-3a33-4a9c-a16d-5ac45d38b67f tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.185763 Jul 28 18:08:02.748130 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 366/743] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:02 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:03.365702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ccef680d-8d51-42b7-a8bb-d2283c0d8910 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:03.366328 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ccef680d-8d51-42b7-a8bb-d2283c0d8910 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:03.373528 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ccef680d-8d51-42b7-a8bb-d2283c0d8910 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:03.373980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ccef680d-8d51-42b7-a8bb-d2283c0d8910 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:03.374814 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ccef680d-8d51-42b7-a8bb-d2283c0d8910 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:03.375258 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ccef680d-8d51-42b7-a8bb-d2283c0d8910 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:03.520440 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ccef680d-8d51-42b7-a8bb-d2283c0d8910 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:03.528079 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ccef680d-8d51-42b7-a8bb-d2283c0d8910 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1508 microversion: 2.1 time: 0.166361 Jul 28 18:08:03.528649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 378/744] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:03 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:03.551898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-eeb1d39a-3913-48c9-a62e-61a80763a8b7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61b99efb-7157-4e1b-8bb0-69ca5a6d8aae", "device": "/dev/sdb"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:03.554319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-eeb1d39a-3913-48c9-a62e-61a80763a8b7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:03.560954 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eeb1d39a-3913-48c9-a62e-61a80763a8b7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:03.563678 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eeb1d39a-3913-48c9-a62e-61a80763a8b7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:03.563678 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eeb1d39a-3913-48c9-a62e-61a80763a8b7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:03.563678 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eeb1d39a-3913-48c9-a62e-61a80763a8b7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:03.634930 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d92920ed-af48-4960-8304-f5192d2d9298 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:03.635595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d92920ed-af48-4960-8304-f5192d2d9298 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:03.643582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d92920ed-af48-4960-8304-f5192d2d9298 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:03.643582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d92920ed-af48-4960-8304-f5192d2d9298 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:03.644057 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d92920ed-af48-4960-8304-f5192d2d9298 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:03.644156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d92920ed-af48-4960-8304-f5192d2d9298 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:03.793728 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d92920ed-af48-4960-8304-f5192d2d9298 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:03.806713 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d92920ed-af48-4960-8304-f5192d2d9298 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1690 microversion: 2.1 time: 0.175858 Jul 28 18:08:03.807650 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 379/745] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:03 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1690 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:03.816720 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:03.817859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:03.831230 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:03.833140 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:03.833385 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:03.834429 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:03.977976 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:03.994887 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:03.998595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:04.001145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bc530aaf-0706-4597-9a30-11bacd8d4214 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.192104 Jul 28 18:08:04.002330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 380/746] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:03 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:04.844461 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-735e1c94-7536-47d1-81d7-e19fe410550c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:04.845104 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-735e1c94-7536-47d1-81d7-e19fe410550c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:04.851261 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-735e1c94-7536-47d1-81d7-e19fe410550c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:04.851708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-735e1c94-7536-47d1-81d7-e19fe410550c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:04.852515 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-735e1c94-7536-47d1-81d7-e19fe410550c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:04.852946 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-735e1c94-7536-47d1-81d7-e19fe410550c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:04.869274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:04.922171 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-735e1c94-7536-47d1-81d7-e19fe410550c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:04.929926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-735e1c94-7536-47d1-81d7-e19fe410550c tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1622 microversion: 2.1 time: 0.090950 Jul 28 18:08:04.930523 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 381/747] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:04 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:05.027181 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:05.028115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:05.034742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:05.035346 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:05.036207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:05.036954 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:05.058397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-eeb1d39a-3913-48c9-a62e-61a80763a8b7 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "POST /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.510378 Jul 28 18:08:05.059088 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 367/748] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:08:03 2022] POST /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39/os-volume_attachments => generated 194 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:08:05.072161 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-ffe26227-b205-4975-90e2-1f758a40a4b6 req-e1c8883d-eef5-436c-b01e-bdfca1ffc44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07dd071c-f443-4fbc-a37c-0b8b250968a4", "name": "network-vif-deleted", "tag": "9f9562ad-51bd-4d8e-b76b-7edbbe736d9f"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:05.103555 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-ffe26227-b205-4975-90e2-1f758a40a4b6 req-e1c8883d-eef5-436c-b01e-bdfca1ffc44f service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:05.105548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-ffe26227-b205-4975-90e2-1f758a40a4b6 req-e1c8883d-eef5-436c-b01e-bdfca1ffc44f service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:05.145063 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-ffe26227-b205-4975-90e2-1f758a40a4b6 req-e1c8883d-eef5-436c-b01e-bdfca1ffc44f service nova] Creating event network-vif-deleted:9f9562ad-51bd-4d8e-b76b-7edbbe736d9f for instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 on hv-cinder-83754 Jul 28 18:08:05.158919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-ffe26227-b205-4975-90e2-1f758a40a4b6 req-e1c8883d-eef5-436c-b01e-bdfca1ffc44f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095810 Jul 28 18:08:05.159705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 368/749] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:08:05.248985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:05.262599 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:05.264655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:05.266011 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cd0d43fa-993f-41d6-8c5f-c1963ed45dee tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.243440 Jul 28 18:08:05.266899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 382/750] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:05 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:05.954272 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:05.955194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:05.962177 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:05.969935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:05.969935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:05.969935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:05.999895 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:06.000355 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:06.000843 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'fault' on Instance uuid 07dd071c-f443-4fbc-a37c-0b8b250968a4 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:08:06.046246 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:06.054037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8897e2f6-0da9-487a-9bbc-ef8029b6b7b3 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 200 len: 1335 microversion: 2.1 time: 0.105805 Jul 28 18:08:06.057297 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 369/751] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:05 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:06.295987 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:06.295987 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:06.301694 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:06.302147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:06.303126 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:06.303720 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:06.443745 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:06.450993 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:06.452532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:06.453803 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5c17523e-138d-4084-b80c-833baa351458 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.164529 Jul 28 18:08:06.454274 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 383/752] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:06 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:07.077185 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:07.077797 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 07dd071c-f443-4fbc-a37c-0b8b250968a4] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:07.084424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:07.084866 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:07.085698 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:07.086158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:07.101548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] HTTP exception thrown: Instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 could not be found. Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Request method failure captured: Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 HTTP/1.1 Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8bdDylPe9TzYYahsE2YdUv8fsr0QRGbahEgRDZbkgtzcrOP3v03mdQwiM6MCmMl9eZdEVy4s00YMO7-3K7iXOaF5PeoG1oWSwvHUFyfpf5uOSXYen8iGBgKIrZ6fIcZity5LUFiDlgE-llaLEg0RohnQWVYBqmOcX-k2IkRZtnZgk Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:08:07.101734 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c1c1587cf20d427e8bb03ffae1b1ce33", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 564e0f9000a1448ea9ea37a2892e6495 Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 could not be found. Jul 28 18:08:07.103397 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '07dd071c-f443-4fbc-a37c-0b8b250968a4'} Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 could not be found. Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:08:07.104325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 could not be found. Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 could not be found. Jul 28 18:08:07.105891 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:07.107699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Returning 404 to user: Instance 07dd071c-f443-4fbc-a37c-0b8b250968a4 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:08:07.107699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-daeccfab-3ea3-44f9-a041-43352d9498a2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4" status: 404 len: 111 microversion: 2.1 time: 0.030488 Jul 28 18:08:07.107699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 370/753] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:07 2022] GET /compute/v2.1/servers/07dd071c-f443-4fbc-a37c-0b8b250968a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:08:07.113240 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b56093a3-eba7-47c1-995a-b4f8fbe23ab8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '.version_select at 0x7fdae038ce50>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:07.206255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b56093a3-eba7-47c1-995a-b4f8fbe23ab8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009658400" status: 202 len: 0 microversion: 2.1 time: 0.097380 Jul 28 18:08:07.206894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 384/754] 10.222.0.85 () {58 vars in 1221 bytes} [Thu Jul 28 18:08:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2009658400 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:08:07.477615 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:07.478131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:07.485396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:07.485860 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:07.486766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:07.487077 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:07.756991 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:07.762952 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:07.764501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:07.765873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b91a5598-91fa-4675-b3d6-5eac78134a85 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.292418 Jul 28 18:08:07.766486 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 371/755] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:07 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:08.791677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:08.792282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:08.798947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:08.799399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:08.800190 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:08.800653 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:08.937546 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:08.945834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:08.947489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:08.948645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-56cb39c1-72bb-4626-9de2-9c36ddfbfc80 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.161544 Jul 28 18:08:08.949189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 385/756] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:08 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:09.971832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:09.972380 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:09.979143 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:09.979595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:09.980372 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:09.980812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:10.118423 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:10.126624 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:10.128124 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:10.129283 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-026e394f-6247-4f65-a867-1b823185bc1a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.161514 Jul 28 18:08:10.129841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 372/757] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:09 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:10.707202 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7f9374eb-e6ce-4a09-8e6a-e869b4273de0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:10.707720 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7f9374eb-e6ce-4a09-8e6a-e869b4273de0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:10.714532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7f9374eb-e6ce-4a09-8e6a-e869b4273de0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:10.714979 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7f9374eb-e6ce-4a09-8e6a-e869b4273de0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:10.715743 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7f9374eb-e6ce-4a09-8e6a-e869b4273de0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:10.716819 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7f9374eb-e6ce-4a09-8e6a-e869b4273de0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:10.742478 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7f9374eb-e6ce-4a09-8e6a-e869b4273de0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Going to try to terminate instance {{(pid=130400) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:08:10.745287 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:11.031509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7f9374eb-e6ce-4a09-8e6a-e869b4273de0 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 204 len: 0 microversion: 2.1 time: 0.327786 Jul 28 18:08:11.032102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 386/758] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:08:10 2022] DELETE /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:08:11.040080 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e0dd1620-979e-49eb-b046-730cbafe9aa8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:11.040687 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e0dd1620-979e-49eb-b046-730cbafe9aa8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:11.048392 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e0dd1620-979e-49eb-b046-730cbafe9aa8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:11.048846 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e0dd1620-979e-49eb-b046-730cbafe9aa8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:11.049756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e0dd1620-979e-49eb-b046-730cbafe9aa8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:11.050099 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e0dd1620-979e-49eb-b046-730cbafe9aa8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:11.154598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:11.155313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:11.161504 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:11.161953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:11.162760 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:11.163410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:11.188213 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e0dd1620-979e-49eb-b046-730cbafe9aa8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:11.196024 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e0dd1620-979e-49eb-b046-730cbafe9aa8 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1507 microversion: 2.1 time: 0.159637 Jul 28 18:08:11.196603 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 373/759] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:11 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:11.301205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:11.309339 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:11.311474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:11.312633 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8d5f2e16-e365-491f-a4aa-0e903b2cdeca tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.163186 Jul 28 18:08:11.313183 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 387/760] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:11 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:12.217661 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f16a6939-a40e-4fce-8752-c06b16237668 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:12.218190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f16a6939-a40e-4fce-8752-c06b16237668 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:12.224873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f16a6939-a40e-4fce-8752-c06b16237668 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:12.225320 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f16a6939-a40e-4fce-8752-c06b16237668 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:12.226091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f16a6939-a40e-4fce-8752-c06b16237668 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:12.226572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f16a6939-a40e-4fce-8752-c06b16237668 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:12.336049 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:12.336649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:12.343503 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:12.343950 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:12.344727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:12.345159 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:12.371667 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f16a6939-a40e-4fce-8752-c06b16237668 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:12.380360 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f16a6939-a40e-4fce-8752-c06b16237668 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1507 microversion: 2.1 time: 0.166535 Jul 28 18:08:12.380925 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 374/761] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:12 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:12.484015 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:12.492029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:12.493521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:12.494857 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cb717e1c-1d6c-48be-a137-5d52bae8cbf3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.162750 Jul 28 18:08:12.495271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 388/762] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:12 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:13.402399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6df7a382-c981-4ce7-ba26-abebbe39e0ea tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:13.404367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6df7a382-c981-4ce7-ba26-abebbe39e0ea tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:13.411018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6df7a382-c981-4ce7-ba26-abebbe39e0ea tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:13.411743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6df7a382-c981-4ce7-ba26-abebbe39e0ea tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:13.412881 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6df7a382-c981-4ce7-ba26-abebbe39e0ea tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:13.413353 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6df7a382-c981-4ce7-ba26-abebbe39e0ea tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:13.518544 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:13.519100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:13.526169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:13.526169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:13.526735 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:13.527162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:13.584776 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6df7a382-c981-4ce7-ba26-abebbe39e0ea tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:13.594157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6df7a382-c981-4ce7-ba26-abebbe39e0ea tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1507 microversion: 2.1 time: 0.196074 Jul 28 18:08:13.594766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 375/763] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:13 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:13.672585 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:13.681454 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:13.684049 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:13.685298 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1b26eb26-6f9d-4aca-b305-b4156c9ff983 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.169923 Jul 28 18:08:13.686479 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 389/764] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:13 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:13.784532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-c23bc345-f494-4bb8-af59-12961fbc6623 req-a46c8ead-028d-481e-a48f-8fc0411c1ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c194fd9-27de-4620-ae13-0d988b2adf4d", "name": "network-vif-deleted", "tag": "c5407d67-f752-4458-a306-d8d20e45c534"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:13.795010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-c23bc345-f494-4bb8-af59-12961fbc6623 req-a46c8ead-028d-481e-a48f-8fc0411c1ea7 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:13.796023 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-c23bc345-f494-4bb8-af59-12961fbc6623 req-a46c8ead-028d-481e-a48f-8fc0411c1ea7 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:13.806650 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-c23bc345-f494-4bb8-af59-12961fbc6623 req-a46c8ead-028d-481e-a48f-8fc0411c1ea7 service nova] Creating event network-vif-deleted:c5407d67-f752-4458-a306-d8d20e45c534 for instance 8c194fd9-27de-4620-ae13-0d988b2adf4d on hv-cinder-83754 Jul 28 18:08:13.812357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-c23bc345-f494-4bb8-af59-12961fbc6623 req-a46c8ead-028d-481e-a48f-8fc0411c1ea7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 Jul 28 18:08:13.813037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 376/765] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:08:14.617120 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:14.617773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:14.624991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:14.639145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:14.639145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:14.639145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:14.658234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:14.658768 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:14.659239 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'fault' on Instance uuid 8c194fd9-27de-4620-ae13-0d988b2adf4d {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:08:14.702245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:14.709865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-107d6c30-2188-47ba-ba0c-0715eecd8e5e tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1311 microversion: 2.1 time: 0.096910 Jul 28 18:08:14.710631 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 390/766] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:14 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:14.714119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:14.714836 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:14.721140 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:14.721617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:14.722401 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:14.722835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:14.858402 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:14.866697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:14.868231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:14.869324 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5555b035-0941-4a90-b3d4-057e04fd30a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.159986 Jul 28 18:08:14.869873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 377/767] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:14 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:15.731251 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:15.732101 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:15.739489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:15.739937 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:15.740703 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:15.741196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:15.772117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:15.772569 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:15.773016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'fault' on Instance uuid 8c194fd9-27de-4620-ae13-0d988b2adf4d {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:08:15.817961 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:15.825567 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-82feb387-2b3a-454b-8f9b-b48cc5c937cb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1311 microversion: 2.1 time: 0.098253 Jul 28 18:08:15.826131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 391/768] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:15 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:15.892469 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:15.893104 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:15.899812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:15.900265 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:15.901031 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:15.901472 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:16.035070 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:16.043022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:16.044508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:16.045668 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-489f6045-589c-488a-8a1a-09b6005565a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.157111 Jul 28 18:08:16.046527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 378/769] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:15 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:16.847674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:16.848280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:16.854995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:16.855441 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:16.856201 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:16.856636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:16.889376 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:16.889811 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:16.890258 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'fault' on Instance uuid 8c194fd9-27de-4620-ae13-0d988b2adf4d {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:08:16.932097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:16.940011 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fd2c8809-a77c-43dd-b1d1-286afe56bbe5 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 200 len: 1311 microversion: 2.1 time: 0.096711 Jul 28 18:08:16.959702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 392/770] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:16 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:17.068056 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:17.068684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:17.075340 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:17.075793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:17.076560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:17.076999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:17.210255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:17.218446 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:17.220763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:17.223971 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-866875ec-55ef-41cf-9b5d-bd0ae54146f4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.158056 Jul 28 18:08:17.223971 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 379/771] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:17 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:17.960894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:17.961505 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: 8c194fd9-27de-4620-ae13-0d988b2adf4d] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:17.968241 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:17.968691 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:17.969489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:17.969931 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:17.983652 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] HTTP exception thrown: Instance 8c194fd9-27de-4620-ae13-0d988b2adf4d could not be found. Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Request method failure captured: Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d HTTP/1.1 Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8bdDylPe9TzYYahsE2YdUv8fsr0QRGbahEgRDZbkgtzcrOP3v03mdQwiM6MCmMl9eZdEVy4s00YMO7-3K7iXOaF5PeoG1oWSwvHUFyfpf5uOSXYen8iGBgKIrZ6fIcZity5LUFiDlgE-llaLEg0RohnQWVYBqmOcX-k2IkRZtnZgk Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:08:17.985297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c1c1587cf20d427e8bb03ffae1b1ce33", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 564e0f9000a1448ea9ea37a2892e6495 Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 8c194fd9-27de-4620-ae13-0d988b2adf4d could not be found. Jul 28 18:08:17.987491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '8c194fd9-27de-4620-ae13-0d988b2adf4d'} Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c194fd9-27de-4620-ae13-0d988b2adf4d could not be found. Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:08:17.988410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c194fd9-27de-4620-ae13-0d988b2adf4d could not be found. Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c194fd9-27de-4620-ae13-0d988b2adf4d could not be found. Jul 28 18:08:17.989995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:17.991521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Returning 404 to user: Instance 8c194fd9-27de-4620-ae13-0d988b2adf4d could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:08:17.991521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d2e0e611-aeef-4651-a207-91a076e203db tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d" status: 404 len: 111 microversion: 2.1 time: 0.030008 Jul 28 18:08:17.991521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 393/772] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:17 2022] GET /compute/v2.1/servers/8c194fd9-27de-4620-ae13-0d988b2adf4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:08:17.996465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-755d72ad-2fd3-476a-ae6c-f6684f9f9bd2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:17.996966 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-755d72ad-2fd3-476a-ae6c-f6684f9f9bd2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:18.004029 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-755d72ad-2fd3-476a-ae6c-f6684f9f9bd2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:18.011374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-755d72ad-2fd3-476a-ae6c-f6684f9f9bd2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:18.011374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-755d72ad-2fd3-476a-ae6c-f6684f9f9bd2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:18.011374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-755d72ad-2fd3-476a-ae6c-f6684f9f9bd2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:18.032357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-755d72ad-2fd3-476a-ae6c-f6684f9f9bd2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:08:18.245502 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:18.246201 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:18.252035 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:18.252542 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:18.253446 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:18.253866 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:18.327030 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-755d72ad-2fd3-476a-ae6c-f6684f9f9bd2 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 204 len: 0 microversion: 2.1 time: 0.334447 Jul 28 18:08:18.327868 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 380/773] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:08:17 2022] DELETE /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:08:18.337561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e5c16962-b008-4d10-9d2c-a45b9905ccb1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:18.338415 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e5c16962-b008-4d10-9d2c-a45b9905ccb1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:18.344783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5c16962-b008-4d10-9d2c-a45b9905ccb1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:18.345466 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5c16962-b008-4d10-9d2c-a45b9905ccb1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:18.347050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5c16962-b008-4d10-9d2c-a45b9905ccb1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:18.347679 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e5c16962-b008-4d10-9d2c-a45b9905ccb1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:18.395834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:18.406165 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:18.407730 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:18.409790 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-235bbc89-6c3d-45cc-8aa9-a4377de5ff42 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.168163 Jul 28 18:08:18.410508 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 394/774] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:18 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:18.487104 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e5c16962-b008-4d10-9d2c-a45b9905ccb1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:18.494679 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e5c16962-b008-4d10-9d2c-a45b9905ccb1 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.162281 Jul 28 18:08:18.495299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 381/775] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:18 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:19.433318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:19.433866 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:19.441114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:19.441557 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:19.442316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:19.442780 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:19.515399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-aa11241e-7339-47a8-8f83-79d9cb9557a7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:19.516007 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-aa11241e-7339-47a8-8f83-79d9cb9557a7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:19.522723 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa11241e-7339-47a8-8f83-79d9cb9557a7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:19.523176 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa11241e-7339-47a8-8f83-79d9cb9557a7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:19.523947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa11241e-7339-47a8-8f83-79d9cb9557a7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:19.524383 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa11241e-7339-47a8-8f83-79d9cb9557a7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:19.578594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:19.587604 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:19.589110 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:19.590302 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3ce97754-b138-4cef-9a5b-262c77e5a4be tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.161026 Jul 28 18:08:19.590877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 395/776] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:19 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:19.657854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-aa11241e-7339-47a8-8f83-79d9cb9557a7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:19.665863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-aa11241e-7339-47a8-8f83-79d9cb9557a7 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.154302 Jul 28 18:08:19.666696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 382/777] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:19 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:20.613936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:20.614580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:20.620947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:20.621391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:20.622141 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:20.622609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:20.688405 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7daaa81c-23d2-4db8-9bcc-43352f072716 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:20.689156 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7daaa81c-23d2-4db8-9bcc-43352f072716 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:20.696814 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7daaa81c-23d2-4db8-9bcc-43352f072716 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:20.697302 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7daaa81c-23d2-4db8-9bcc-43352f072716 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:20.698247 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7daaa81c-23d2-4db8-9bcc-43352f072716 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:20.698723 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7daaa81c-23d2-4db8-9bcc-43352f072716 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:20.755796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:20.765335 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:20.766894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:20.768059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9858c7f7-10b1-4918-a733-8132d1b602a6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.158163 Jul 28 18:08:20.768656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 396/778] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:20 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:20.834415 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7daaa81c-23d2-4db8-9bcc-43352f072716 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:20.842291 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7daaa81c-23d2-4db8-9bcc-43352f072716 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.157930 Jul 28 18:08:20.842884 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 383/779] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:20 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:21.791255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:21.791801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:21.798710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:21.799158 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:21.799977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:21.800410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:21.863719 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b43c1517-26a2-4b78-a832-cae9b6a9c6a6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:21.864328 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b43c1517-26a2-4b78-a832-cae9b6a9c6a6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:21.870917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b43c1517-26a2-4b78-a832-cae9b6a9c6a6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:21.871363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b43c1517-26a2-4b78-a832-cae9b6a9c6a6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:21.872137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b43c1517-26a2-4b78-a832-cae9b6a9c6a6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:21.872575 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b43c1517-26a2-4b78-a832-cae9b6a9c6a6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:21.877577 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:21.934003 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:21.942736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:21.944304 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:21.945657 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4401e99d-da9e-4550-a89a-465c8b53b48c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.158297 Jul 28 18:08:21.946217 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 397/780] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:21 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:22.010396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b43c1517-26a2-4b78-a832-cae9b6a9c6a6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:22.017860 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b43c1517-26a2-4b78-a832-cae9b6a9c6a6 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1521 microversion: 2.1 time: 0.158272 Jul 28 18:08:22.018441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 384/781] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:21 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:22.872313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-c2008b7c-f1f9-4370-b2f1-fc64797a72fc req-ebc2db54-effa-4eb0-b060-7ee5772ee0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e09c2f70-20f1-4762-b7ea-36d9ef650f15", "name": "network-vif-deleted", "tag": "66e48c64-aab6-4386-8f4e-c36d3e4b5fc0"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:22.883203 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-c2008b7c-f1f9-4370-b2f1-fc64797a72fc req-ebc2db54-effa-4eb0-b060-7ee5772ee0c0 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:22.883645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-c2008b7c-f1f9-4370-b2f1-fc64797a72fc req-ebc2db54-effa-4eb0-b060-7ee5772ee0c0 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:22.896880 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-c2008b7c-f1f9-4370-b2f1-fc64797a72fc req-ebc2db54-effa-4eb0-b060-7ee5772ee0c0 service nova] Creating event network-vif-deleted:66e48c64-aab6-4386-8f4e-c36d3e4b5fc0 for instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 on hv-cinder-83754 Jul 28 18:08:22.902236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-c2008b7c-f1f9-4370-b2f1-fc64797a72fc req-ebc2db54-effa-4eb0-b060-7ee5772ee0c0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037603 Jul 28 18:08:22.902867 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 398/782] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:08:22.970059 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:22.970631 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:22.977356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:22.977804 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:22.978604 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:22.979040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:23.040082 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1ad33d0e-11a7-4b65-8fac-965abc336268 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:23.040883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1ad33d0e-11a7-4b65-8fac-965abc336268 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:23.047244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ad33d0e-11a7-4b65-8fac-965abc336268 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:23.047696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ad33d0e-11a7-4b65-8fac-965abc336268 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:23.048461 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ad33d0e-11a7-4b65-8fac-965abc336268 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:23.048895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ad33d0e-11a7-4b65-8fac-965abc336268 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:23.125646 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1ad33d0e-11a7-4b65-8fac-965abc336268 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:23.127168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:23.134238 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1ad33d0e-11a7-4b65-8fac-965abc336268 tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1479 microversion: 2.1 time: 0.098328 Jul 28 18:08:23.135280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 399/783] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:23 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1479 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:23.137460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:23.139126 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:23.140649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c13b94e4-41b3-48dc-9176-e4ce8dc7af13 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.174648 Jul 28 18:08:23.141288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 385/784] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:22 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:24.156369 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:24.157129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:24.164352 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:24.164652 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:24.165111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:24.171848 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:24.172038 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:24.172130 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:24.172357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:24.172808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:24.173790 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:24.174228 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:24.199259 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:24.199698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:24.200140 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lazy-loading 'fault' on Instance uuid e09c2f70-20f1-4762-b7ea-36d9ef650f15 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:08:24.242971 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564e0f9000a1448ea9ea37a2892e6495', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c1587cf20d427e8bb03ffae1b1ce33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:24.250195 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-49c8b8d8-36f4-478c-97b4-b334d45da92b tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 200 len: 1312 microversion: 2.1 time: 0.098385 Jul 28 18:08:24.251054 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 400/785] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:24 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:24.313351 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:24.322604 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:24.324134 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:24.325329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b7e1138b-9cfd-46c8-99d4-952e6dc8a138 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.165914 Jul 28 18:08:24.325882 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 386/786] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:24 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:25.272441 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:25.273047 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] [instance: e09c2f70-20f1-4762-b7ea-36d9ef650f15] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:25.279532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:25.279980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:25.280738 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:25.281170 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:25.295379 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] HTTP exception thrown: Instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 could not be found. Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Request method failure captured: Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 HTTP/1.1 Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8bdDylPe9TzYYahsE2YdUv8fsr0QRGbahEgRDZbkgtzcrOP3v03mdQwiM6MCmMl9eZdEVy4s00YMO7-3K7iXOaF5PeoG1oWSwvHUFyfpf5uOSXYen8iGBgKIrZ6fIcZity5LUFiDlgE-llaLEg0RohnQWVYBqmOcX-k2IkRZtnZgk Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:08:25.297052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_c1c1587cf20d427e8bb03ffae1b1ce33", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/c1c1587cf20d427e8bb03ffae1b1ce33"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: c1c1587cf20d427e8bb03ffae1b1ce33 Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-134096573 Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 564e0f9000a1448ea9ea37a2892e6495 Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-ServerRescueNegativeTestJSON-134096573-project Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 could not be found. Jul 28 18:08:25.298627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': 'e09c2f70-20f1-4762-b7ea-36d9ef650f15'} Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 could not be found. Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:08:25.299487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 could not be found. Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 could not be found. Jul 28 18:08:25.300957 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:08:25.302316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] Returning 404 to user: Instance e09c2f70-20f1-4762-b7ea-36d9ef650f15 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:08:25.302316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4c27077f-49b7-4b18-a5cb-02d9e7003feb tempest-ServerRescueNegativeTestJSON-134096573 tempest-ServerRescueNegativeTestJSON-134096573-project] 10.222.0.85 "GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15" status: 404 len: 111 microversion: 2.1 time: 0.030402 Jul 28 18:08:25.302316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 401/787] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:25 2022] GET /compute/v2.1/servers/e09c2f70-20f1-4762-b7ea-36d9ef650f15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:08:25.349119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:25.350433 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:25.357474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:25.358176 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:25.359042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:25.359630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:25.764645 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:25.773766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:25.775327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:25.776795 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-02407f2c-4dbc-4700-a84c-81af2094d446 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.432496 Jul 28 18:08:25.777355 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 387/788] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:25 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:26.517953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8216d013-a20b-44b7-9ade-40d042b625c2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:26.518625 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8216d013-a20b-44b7-9ade-40d042b625c2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:26.525960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8216d013-a20b-44b7-9ade-40d042b625c2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:26.527733 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8216d013-a20b-44b7-9ade-40d042b625c2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:26.527733 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8216d013-a20b-44b7-9ade-40d042b625c2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:26.527921 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8216d013-a20b-44b7-9ade-40d042b625c2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:26.547899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:26.625987 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-8216d013-a20b-44b7-9ade-40d042b625c2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lazy-loading 'services' on Instance uuid 4ad828ea-8b73-4f24-aa97-acb56da85c39 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:08:26.803561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:26.804815 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:26.812881 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:26.813352 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:26.814625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:26.814861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:26.866045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8216d013-a20b-44b7-9ade-40d042b625c2 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39/os-volume_attachments/61b99efb-7157-4e1b-8bb0-69ca5a6d8aae" status: 202 len: 0 microversion: 2.1 time: 0.351717 Jul 28 18:08:26.866990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 402/789] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:08:26 2022] DELETE /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39/os-volume_attachments/61b99efb-7157-4e1b-8bb0-69ca5a6d8aae => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:08:27.079481 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:27.089662 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:27.091472 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:27.092643 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a7f3a910-d31e-4504-b3e7-6ad90ae38f89 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.293284 Jul 28 18:08:27.093363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 388/790] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:26 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:28.119019 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:28.119813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:28.126627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:28.127269 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:28.128643 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:28.129285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:28.279857 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:28.289068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:28.290667 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:28.291872 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f1f5e9a7-5788-4ba4-9cd4-6127a90a3d1b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.177660 Jul 28 18:08:28.292434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 403/791] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:28 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:29.149730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-704fad16-3467-463e-8735-8c0b594d7e12 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:29.150276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-704fad16-3467-463e-8735-8c0b594d7e12 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:29.156580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-704fad16-3467-463e-8735-8c0b594d7e12 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:29.157023 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-704fad16-3467-463e-8735-8c0b594d7e12 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:29.157789 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-704fad16-3467-463e-8735-8c0b594d7e12 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:29.158237 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-704fad16-3467-463e-8735-8c0b594d7e12 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:29.193720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-704fad16-3467-463e-8735-8c0b594d7e12 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:08:29.317075 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:29.317613 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:29.320310 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:29.325335 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:29.325789 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:29.326611 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:29.327048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:29.474024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:29.481592 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:29.483131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:29.484310 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4ba70f44-530c-4f32-931c-9ab6947ad2d4 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.172654 Jul 28 18:08:29.484859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 404/792] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:29 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:29.548918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-704fad16-3467-463e-8735-8c0b594d7e12 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 204 len: 0 microversion: 2.1 time: 0.402967 Jul 28 18:08:29.549752 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 389/793] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:08:29 2022] DELETE /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:08:29.557970 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-886acf70-ffa0-4aad-9f20-eb3d1ec39862 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:29.558606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-886acf70-ffa0-4aad-9f20-eb3d1ec39862 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:29.564426 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-886acf70-ffa0-4aad-9f20-eb3d1ec39862 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:29.565534 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-886acf70-ffa0-4aad-9f20-eb3d1ec39862 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:29.566549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-886acf70-ffa0-4aad-9f20-eb3d1ec39862 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:29.567035 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-886acf70-ffa0-4aad-9f20-eb3d1ec39862 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:29.699771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-886acf70-ffa0-4aad-9f20-eb3d1ec39862 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:29.707362 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-886acf70-ffa0-4aad-9f20-eb3d1ec39862 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1514 microversion: 2.1 time: 0.153337 Jul 28 18:08:29.707919 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 405/794] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:29 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:30.514729 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:30.515420 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:30.517784 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:30.523263 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:30.523701 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:30.524459 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:30.524885 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:30.729317 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-65eb690c-f118-4015-9d5a-4ed5b56d9451 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:30.730810 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-65eb690c-f118-4015-9d5a-4ed5b56d9451 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:30.738581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-65eb690c-f118-4015-9d5a-4ed5b56d9451 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:30.742595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-65eb690c-f118-4015-9d5a-4ed5b56d9451 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:30.742595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-65eb690c-f118-4015-9d5a-4ed5b56d9451 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:30.742595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-65eb690c-f118-4015-9d5a-4ed5b56d9451 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:30.900886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-65eb690c-f118-4015-9d5a-4ed5b56d9451 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:30.908924 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-65eb690c-f118-4015-9d5a-4ed5b56d9451 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1514 microversion: 2.1 time: 0.184006 Jul 28 18:08:30.909481 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 406/795] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:30 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:30.923455 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:30.931722 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:30.933135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:30.934306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-212cffd8-cee6-4204-afd0-3cc1215500e0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1743 microversion: 2.20 time: 0.425286 Jul 28 18:08:30.934877 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 390/796] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:30 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1743 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:31.895541 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-4ee5dcf4-74db-40a6-b77c-0db00dc84802 req-0e3f7723-0518-42a1-9961-bac4c3d63fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ad828ea-8b73-4f24-aa97-acb56da85c39", "name": "network-vif-deleted", "tag": "79345ca0-155b-4b17-bb3b-13344d9bcff1"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:31.905504 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-4ee5dcf4-74db-40a6-b77c-0db00dc84802 req-0e3f7723-0518-42a1-9961-bac4c3d63fcc service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:31.905943 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-4ee5dcf4-74db-40a6-b77c-0db00dc84802 req-0e3f7723-0518-42a1-9961-bac4c3d63fcc service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:31.916881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-4ee5dcf4-74db-40a6-b77c-0db00dc84802 req-0e3f7723-0518-42a1-9961-bac4c3d63fcc service nova] Creating event network-vif-deleted:79345ca0-155b-4b17-bb3b-13344d9bcff1 for instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 on hv-cinder-83754 Jul 28 18:08:31.921949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-4ee5dcf4-74db-40a6-b77c-0db00dc84802 req-0e3f7723-0518-42a1-9961-bac4c3d63fcc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031293 Jul 28 18:08:31.922636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 407/797] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:08:31.931212 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-22fc71d4-b934-4596-a808-2402f04c7be4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:31.931835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-22fc71d4-b934-4596-a808-2402f04c7be4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:31.937887 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-22fc71d4-b934-4596-a808-2402f04c7be4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:31.938337 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-22fc71d4-b934-4596-a808-2402f04c7be4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:31.939134 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-22fc71d4-b934-4596-a808-2402f04c7be4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:31.939571 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-22fc71d4-b934-4596-a808-2402f04c7be4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:31.964623 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:31.965566 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:31.974710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:31.975198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:31.976100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:31.976545 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:32.033465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-22fc71d4-b934-4596-a808-2402f04c7be4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:32.044081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-22fc71d4-b934-4596-a808-2402f04c7be4 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1472 microversion: 2.1 time: 0.117412 Jul 28 18:08:32.045221 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 391/798] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:31 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1472 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:32.187460 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:32.197081 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:32.198616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:32.199781 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d53d29d4-654c-40e3-b835-7656655f2f00 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1743 microversion: 2.20 time: 0.241562 Jul 28 18:08:32.200339 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 408/799] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:31 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:33.065488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:33.066546 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:33.073513 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:33.073971 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:33.074776 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:33.075211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:33.114873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:33.115318 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:33.115767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lazy-loading 'fault' on Instance uuid 4ad828ea-8b73-4f24-aa97-acb56da85c39 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:08:33.162438 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7941170fe74f9c818f4ab612fca33f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '613c6d4f37814a209077ac2c19506674', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:33.169713 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d56816f5-cbb2-4202-89d1-0f31ea229c6a tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 200 len: 1309 microversion: 2.1 time: 0.107983 Jul 28 18:08:33.170595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 392/800] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:33 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:33.224150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:33.224758 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:33.231582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:33.232028 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:33.232852 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:33.233276 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:33.429022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:33.437495 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:33.439039 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:33.440244 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-df275fc2-5195-44cf-9d5c-d792aca5f7cf tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.220903 Jul 28 18:08:33.444482 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 409/801] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:33 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:34.195367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:34.197237 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] [instance: 4ad828ea-8b73-4f24-aa97-acb56da85c39] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:34.206882 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:34.208821 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:34.211333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:34.213317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:34.239675 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] HTTP exception thrown: Instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 could not be found. Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Request method failure captured: Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 HTTP/1.1 Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tAHUKmYSsL-ChNNO1GXUUSUSBi9ngD-NVtOQPUOWwwaYkD6KS-PI93NifV_svkOYV9lvogb97Xc-EgYh8Jw1fkSsUkHrbf8K2LPdZ4bRbDAWwNsNp2d3d0ApKu130ZM8gpopjrABKTIsn7kHJL5Hr_TzWFqH-8IEGdNBTkgBkDLDas Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 613c6d4f37814a209077ac2c19506674 Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1669713520 Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:08:34.244390 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/613c6d4f37814a209077ac2c19506674"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_613c6d4f37814a209077ac2c19506674", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/613c6d4f37814a209077ac2c19506674"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/613c6d4f37814a209077ac2c19506674"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-VolumesSnapshotTestJSON-1669713520 Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 613c6d4f37814a209077ac2c19506674 Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1669713520 Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-VolumesSnapshotTestJSON-1669713520-project Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: aa7941170fe74f9c818f4ab612fca33f Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-VolumesSnapshotTestJSON-1669713520-project Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 could not be found. Jul 28 18:08:34.245853 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '4ad828ea-8b73-4f24-aa97-acb56da85c39'} Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 could not be found. Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:08:34.247135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 could not be found. Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 could not be found. Jul 28 18:08:34.248424 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:08:34.253033 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] Returning 404 to user: Instance 4ad828ea-8b73-4f24-aa97-acb56da85c39 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:08:34.254804 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6b6964d1-5525-43bc-b3c9-23bde1c4f670 tempest-VolumesSnapshotTestJSON-1669713520 tempest-VolumesSnapshotTestJSON-1669713520-project] 10.222.0.85 "GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39" status: 404 len: 111 microversion: 2.1 time: 0.066592 Jul 28 18:08:34.255627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 393/802] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:34 2022] GET /compute/v2.1/servers/4ad828ea-8b73-4f24-aa97-acb56da85c39 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:08:34.474317 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:34.478525 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:34.491964 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:34.506417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:34.507447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:34.507900 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:34.560983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-387b9f33-864b-40a2-84d7-d208b8e44b44 req-88a8c4bf-3585-423b-9db3-41139ba96112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ad8548-670a-4120-9652-2c63a78dd575", "name": "network-vif-plugged", "status": "completed", "tag": "7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:34.591654 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-387b9f33-864b-40a2-84d7-d208b8e44b44 req-88a8c4bf-3585-423b-9db3-41139ba96112 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:34.592016 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-387b9f33-864b-40a2-84d7-d208b8e44b44 req-88a8c4bf-3585-423b-9db3-41139ba96112 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:34.618568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-387b9f33-864b-40a2-84d7-d208b8e44b44 req-88a8c4bf-3585-423b-9db3-41139ba96112 service nova] Creating event network-vif-plugged:7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1 for instance b6ad8548-670a-4120-9652-2c63a78dd575 on hv-cinder-83754 Jul 28 18:08:34.628066 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-387b9f33-864b-40a2-84d7-d208b8e44b44 req-88a8c4bf-3585-423b-9db3-41139ba96112 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072523 Jul 28 18:08:34.628978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 394/803] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:08:34.761042 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:34.772479 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:34.776038 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:34.776038 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4b3ba43c-42a2-424c-ad0e-afb1a33e1a25 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.315338 Jul 28 18:08:34.776038 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 410/804] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:34 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:35.806857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:35.808208 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:35.827863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:35.828629 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:35.829578 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:35.830204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:36.021262 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:36.039120 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:36.040959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:36.043294 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8b155067-8e1c-4564-96be-c2293c7a2190 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.244998 Jul 28 18:08:36.055174 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 395/805] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:35 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:37.071517 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:37.072108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:37.081037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:37.081669 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:37.082764 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:37.083355 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:37.273249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:37.285148 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:37.286958 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:37.288309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e7406eaa-c526-46fc-a681-b208ac311ea8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.222312 Jul 28 18:08:37.289205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 411/806] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:37 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:38.313198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:38.315500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:38.322322 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:38.322807 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:38.324051 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:38.324565 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:38.586230 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:38.599257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:38.600900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:38.602249 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d84e69d1-a27c-4301-97aa-08ae325f1deb tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.292989 Jul 28 18:08:38.611035 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 396/807] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:38 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:39.054656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c5e670b5-734c-40c3-bb3f-7dd337047e38 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'create', calling method: .version_select at 0x7fdae02e99d0>, body: {"keypair": {"name": "tempest-keypair-1123437866", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBKr4Bu38Wbf1zujQSNSfjB18uR2V187NGd8F/EJgP7CE5V2w5xI7RcMkPbs6VBKRO+hk/EHEFniQvNQUlihDROFDOuZGL81uJ6HmGT+Yu3zajQ0MidVZDlTa92ZdDvGPQ=="}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:39.077211 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-c5e670b5-734c-40c3-bb3f-7dd337047e38 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Getting quotas for project f4857a4e9170472da43e01f442099c29. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:08:39.084755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-c5e670b5-734c-40c3-bb3f-7dd337047e38 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Getting quotas for user f26806f1da1b4e98a867fab87249f9fe and project f4857a4e9170472da43e01f442099c29. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:08:39.195955 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c5e670b5-734c-40c3-bb3f-7dd337047e38 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.324126 Jul 28 18:08:39.202799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 412/808] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:08:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:08:39.628160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:39.628896 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:39.635093 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:39.635540 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:39.638794 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:39.639669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:39.825970 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:39.840920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:39.843330 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:39.844879 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-dc23f64d-8c6a-4a46-b5d7-5b217afc2103 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.222862 Jul 28 18:08:39.846181 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 397/809] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:39 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:40.880854 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:40.881332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:40.898935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:40.899471 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:40.900441 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:40.900876 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:41.170275 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:41.193103 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:41.199775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:41.205121 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2f39c434-6a4c-4664-82a3-9437d7802b2c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.325401 Jul 28 18:08:41.205801 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 413/810] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:40 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:42.233411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:42.234085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:42.242912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:42.243472 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:42.244486 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:42.245159 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:42.405861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:42.417806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:42.419840 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:42.421358 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8c4be107-6191-4b02-aa02-499fb59acc53 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.192268 Jul 28 18:08:42.425555 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 398/811] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:42 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:43.122555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1590799452", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8f74a8f-6f5e-40d7-9e04-7b25ad085712"}], "security_groups": [{"name": "tempest-securitygroup--327528831"}], "key_name": "tempest-keypair-1123437866", "user_data": "}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:43.277105 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] validate_networks() for [('f8f74a8f-6f5e-40d7-9e04-7b25ad085712', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:08:43.447302 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:43.448812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:43.455680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:43.456466 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:43.457524 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:43.458175 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:43.636952 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:43.647925 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:43.650622 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:43.652049 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2e36dfdf-a07e-4e2d-9b17-4c920bb7b654 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.210049 Jul 28 18:08:43.653182 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 399/812] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:43 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:08:43.739043 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:08:43.739860 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:08:43.740759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:08:43.741266 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:08:43.741758 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:08:43.753471 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:43.754019 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:43.755111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:43.755756 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:43.775380 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Getting quotas for project f4857a4e9170472da43e01f442099c29. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:08:43.779692 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Getting quotas for user f26806f1da1b4e98a867fab87249f9fe and project f4857a4e9170472da43e01f442099c29. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:08:43.795309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:08:43.797656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:08:43.996999 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d43d9a12-ca82-46f9-be7f-2df4b0736ef4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.879351 Jul 28 18:08:44.003676 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 414/813] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:08:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:08:44.009684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c399094c-317f-4211-925c-741821f256b3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:44.010392 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c399094c-317f-4211-925c-741821f256b3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:44.108345 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c399094c-317f-4211-925c-741821f256b3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:44.116497 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c399094c-317f-4211-925c-741821f256b3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1238 microversion: 2.1 time: 0.111509 Jul 28 18:08:44.122410 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 400/814] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:44 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:44.677935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:44.679499 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:44.686969 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:44.687745 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:44.688783 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:44.690052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:44.852396 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:44.862072 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:44.863623 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:44.864863 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-eece06e9-5185-4826-8446-45137c4ca8b3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.192069 Jul 28 18:08:44.865859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 415/815] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:44 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:45.144449 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-216b138c-ef35-4c65-8797-60a2ec427d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:45.146368 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-216b138c-ef35-4c65-8797-60a2ec427d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:45.211271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-216b138c-ef35-4c65-8797-60a2ec427d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:45.219110 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-216b138c-ef35-4c65-8797-60a2ec427d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1238 microversion: 2.1 time: 0.079115 Jul 28 18:08:45.219689 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 401/816] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:45 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:45.889577 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:45.890187 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:45.898067 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:45.898786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:45.899559 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:45.899988 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:46.043382 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:46.051721 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:46.053221 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:46.054502 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b700f215-0652-4699-a3ac-f108d2fa757c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.169034 Jul 28 18:08:46.055090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 416/817] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:45 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:46.242617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2195b61e-5edc-4c2a-a4e7-6ea417d64c7c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:46.243378 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2195b61e-5edc-4c2a-a4e7-6ea417d64c7c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:46.250226 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2195b61e-5edc-4c2a-a4e7-6ea417d64c7c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:46.250708 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2195b61e-5edc-4c2a-a4e7-6ea417d64c7c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:46.251518 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2195b61e-5edc-4c2a-a4e7-6ea417d64c7c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:46.252680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2195b61e-5edc-4c2a-a4e7-6ea417d64c7c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:46.256911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:46.319840 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2195b61e-5edc-4c2a-a4e7-6ea417d64c7c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:46.328136 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2195b61e-5edc-4c2a-a4e7-6ea417d64c7c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1290 microversion: 2.1 time: 0.089441 Jul 28 18:08:46.328824 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 402/818] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:46 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:47.077189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:47.077841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:47.088448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:47.089185 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:47.090329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:47.091089 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:47.274962 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:47.284834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:47.286626 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:47.287809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c603dd54-ad48-4bf5-b5fa-c17729e13fb2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.214505 Jul 28 18:08:47.290808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 417/819] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:47 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:47.358453 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-224da852-e8ac-4868-9473-9e847006dae5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:47.360338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-224da852-e8ac-4868-9473-9e847006dae5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:47.379500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-224da852-e8ac-4868-9473-9e847006dae5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:47.381087 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-224da852-e8ac-4868-9473-9e847006dae5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:47.384561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-224da852-e8ac-4868-9473-9e847006dae5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:47.386191 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-224da852-e8ac-4868-9473-9e847006dae5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:47.472856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-224da852-e8ac-4868-9473-9e847006dae5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:47.480298 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-224da852-e8ac-4868-9473-9e847006dae5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1308 microversion: 2.1 time: 0.134230 Jul 28 18:08:47.481150 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 403/820] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:47 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:48.315070 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:48.315721 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:48.322916 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:48.323434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:48.324250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:48.324689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:48.463810 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:48.475702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:48.477556 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:48.479234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a059d533-4feb-4a36-adf3-98d3b70717b6 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1738 microversion: 2.20 time: 0.168011 Jul 28 18:08:48.480990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 418/821] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:48 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:48.503744 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-445d0d4e-e49d-4d47-8352-a9d8236b953c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:48.504357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-445d0d4e-e49d-4d47-8352-a9d8236b953c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:48.511303 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-445d0d4e-e49d-4d47-8352-a9d8236b953c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:48.511769 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-445d0d4e-e49d-4d47-8352-a9d8236b953c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:48.512548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-445d0d4e-e49d-4d47-8352-a9d8236b953c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:48.512978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-445d0d4e-e49d-4d47-8352-a9d8236b953c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:48.912571 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-445d0d4e-e49d-4d47-8352-a9d8236b953c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:48.920487 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-445d0d4e-e49d-4d47-8352-a9d8236b953c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.420643 Jul 28 18:08:48.921061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 404/822] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:48 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:49.504247 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:49.504844 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:49.511349 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:49.511791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:49.512542 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:49.513020 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:49.620637 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-5ec6f579-238c-48b2-9821-ae0fd10fd316 req-81e5a3e6-06e4-46a8-8a0c-82eb4dbdd7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875a9106-a56f-4acb-9056-7672341ebccc", "tag": "23f7eafd-8248-4438-9837-008bc6b5122c"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:49.633437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-5ec6f579-238c-48b2-9821-ae0fd10fd316 req-81e5a3e6-06e4-46a8-8a0c-82eb4dbdd7b5 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:49.633982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-5ec6f579-238c-48b2-9821-ae0fd10fd316 req-81e5a3e6-06e4-46a8-8a0c-82eb4dbdd7b5 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:49.648109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-5ec6f579-238c-48b2-9821-ae0fd10fd316 req-81e5a3e6-06e4-46a8-8a0c-82eb4dbdd7b5 service nova] Creating event network-changed:23f7eafd-8248-4438-9837-008bc6b5122c for instance 875a9106-a56f-4acb-9056-7672341ebccc on hv-cinder-83754 Jul 28 18:08:49.656071 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:49.661408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-5ec6f579-238c-48b2-9821-ae0fd10fd316 req-81e5a3e6-06e4-46a8-8a0c-82eb4dbdd7b5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045525 Jul 28 18:08:49.662023 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 405/823] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:08:49.667791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:49.671136 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:49.672313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3428fff5-645b-4ad0-9599-d638a6aa4c15 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1720 microversion: 2.20 time: 0.173079 Jul 28 18:08:49.674390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 419/824] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:49 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:49.947094 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f5b2aaf4-bb15-4a4f-9768-11c5d6d73562 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:49.947785 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f5b2aaf4-bb15-4a4f-9768-11c5d6d73562 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:49.954384 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f5b2aaf4-bb15-4a4f-9768-11c5d6d73562 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:49.955414 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f5b2aaf4-bb15-4a4f-9768-11c5d6d73562 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:49.956188 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f5b2aaf4-bb15-4a4f-9768-11c5d6d73562 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:49.956630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f5b2aaf4-bb15-4a4f-9768-11c5d6d73562 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:50.112043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f5b2aaf4-bb15-4a4f-9768-11c5d6d73562 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:50.120001 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f5b2aaf4-bb15-4a4f-9768-11c5d6d73562 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.177303 Jul 28 18:08:50.120727 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 406/825] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:49 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:50.696590 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:50.697393 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:50.704245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:50.704693 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:50.705466 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:50.705900 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:50.841411 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:50.844951 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:50.849779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:50.851285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:50.852429 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ace83eaf-82d1-471f-a325-2a42a2984123 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1720 microversion: 2.20 time: 0.159834 Jul 28 18:08:50.852976 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 420/826] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:50 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:51.140524 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2bdaffea-52e6-45fb-a727-d77929180649 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:51.141133 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2bdaffea-52e6-45fb-a727-d77929180649 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:51.147728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2bdaffea-52e6-45fb-a727-d77929180649 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:51.148178 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2bdaffea-52e6-45fb-a727-d77929180649 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:51.148942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2bdaffea-52e6-45fb-a727-d77929180649 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:51.149376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2bdaffea-52e6-45fb-a727-d77929180649 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:51.284897 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2bdaffea-52e6-45fb-a727-d77929180649 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:51.292332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2bdaffea-52e6-45fb-a727-d77929180649 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.155633 Jul 28 18:08:51.292892 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 407/827] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:51 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:51.877025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:51.877818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:51.885294 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:51.885769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:51.886568 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:51.887022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:52.109521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:52.118432 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:52.120019 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:52.121271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ec131350-4508-41ce-887d-8b1631dfdd0e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1720 microversion: 2.20 time: 0.248587 Jul 28 18:08:52.121939 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 421/828] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:51 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:52.312818 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-26be1379-e70a-4376-916e-fb69690980b8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:52.313416 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-26be1379-e70a-4376-916e-fb69690980b8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:52.320344 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-26be1379-e70a-4376-916e-fb69690980b8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:52.320799 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-26be1379-e70a-4376-916e-fb69690980b8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:52.321567 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-26be1379-e70a-4376-916e-fb69690980b8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:52.330538 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-26be1379-e70a-4376-916e-fb69690980b8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:52.463806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-26be1379-e70a-4376-916e-fb69690980b8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:52.463806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-26be1379-e70a-4376-916e-fb69690980b8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.153211 Jul 28 18:08:52.463806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 408/829] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:52 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:53.145270 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:53.145910 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:53.152452 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:53.152903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:53.153691 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:53.154128 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:53.292330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:53.301701 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:53.307512 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:53.307512 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f4b73fc3-e77e-434e-b55c-fa14e34a55b2 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1720 microversion: 2.20 time: 0.163138 Jul 28 18:08:53.307512 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 422/830] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:53 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:53.355989 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-7ecf3d11-8fdb-4a01-b9ce-48f4b2e395e7 req-53a73425-a192-40ee-8752-329e3c4ef039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ad8548-670a-4120-9652-2c63a78dd575", "name": "network-vif-unplugged", "status": "completed", "tag": "7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:53.366791 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-7ecf3d11-8fdb-4a01-b9ce-48f4b2e395e7 req-53a73425-a192-40ee-8752-329e3c4ef039 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:53.367392 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-7ecf3d11-8fdb-4a01-b9ce-48f4b2e395e7 req-53a73425-a192-40ee-8752-329e3c4ef039 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:53.379810 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-7ecf3d11-8fdb-4a01-b9ce-48f4b2e395e7 req-53a73425-a192-40ee-8752-329e3c4ef039 service nova] Creating event network-vif-unplugged:7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1 for instance b6ad8548-670a-4120-9652-2c63a78dd575 on hv-cinder-83754 Jul 28 18:08:53.384872 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-7ecf3d11-8fdb-4a01-b9ce-48f4b2e395e7 req-53a73425-a192-40ee-8752-329e3c4ef039 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032572 Jul 28 18:08:53.385855 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 409/831] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:08:53.485026 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3bd32196-bcd1-44e6-8341-69d20065b2de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:53.486377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3bd32196-bcd1-44e6-8341-69d20065b2de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:53.492522 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3bd32196-bcd1-44e6-8341-69d20065b2de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:53.492972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3bd32196-bcd1-44e6-8341-69d20065b2de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:53.493736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3bd32196-bcd1-44e6-8341-69d20065b2de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:53.494170 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3bd32196-bcd1-44e6-8341-69d20065b2de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:53.632573 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3bd32196-bcd1-44e6-8341-69d20065b2de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:53.640051 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3bd32196-bcd1-44e6-8341-69d20065b2de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.158864 Jul 28 18:08:53.640610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 423/832] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:53 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:54.328403 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:54.329130 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:54.336277 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:54.336731 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:54.337496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:54.337930 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:54.473432 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:54.481605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:54.483126 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:54.484283 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a64e77c2-b556-4088-9349-352c0ea0ab12 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1720 microversion: 2.20 time: 0.160244 Jul 28 18:08:54.484869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 410/833] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:54 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:54.661442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1934040e-1d89-4546-b606-e453db7e8e51 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:54.662037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1934040e-1d89-4546-b606-e453db7e8e51 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:54.663937 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:54.664644 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=10 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:54.670150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1934040e-1d89-4546-b606-e453db7e8e51 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:54.670564 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1934040e-1d89-4546-b606-e453db7e8e51 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:54.671377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1934040e-1d89-4546-b606-e453db7e8e51 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:54.671813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1934040e-1d89-4546-b606-e453db7e8e51 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:54.806754 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1934040e-1d89-4546-b606-e453db7e8e51 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:54.814403 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1934040e-1d89-4546-b606-e453db7e8e51 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.157177 Jul 28 18:08:54.814970 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 424/834] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:54 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:55.508466 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:55.509058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:55.511039 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=4 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:08:55.516281 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:55.517447 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:55.518195 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:55.518669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:55.653303 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:55.661427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:55.663003 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:55.664180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e1356ea5-002f-44fc-8f62-cd3080316635 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1663 microversion: 2.20 time: 0.159676 Jul 28 18:08:55.664743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 411/835] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:55 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:55.691669 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-40d6bbde-6fe2-45d5-9e4d-6cdcdc2d9193 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cf7ca6c-0203-4079-91f6-2759984de61f"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:55.694118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-40d6bbde-6fe2-45d5-9e4d-6cdcdc2d9193 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:55.700661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-40d6bbde-6fe2-45d5-9e4d-6cdcdc2d9193 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:55.701106 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-40d6bbde-6fe2-45d5-9e4d-6cdcdc2d9193 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:55.701871 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-40d6bbde-6fe2-45d5-9e4d-6cdcdc2d9193 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:55.702302 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-40d6bbde-6fe2-45d5-9e4d-6cdcdc2d9193 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:55.836184 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-133053a5-cce2-4474-94fe-eed5ffd7eda8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:55.836811 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-133053a5-cce2-4474-94fe-eed5ffd7eda8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:55.843822 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-133053a5-cce2-4474-94fe-eed5ffd7eda8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:55.844274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-133053a5-cce2-4474-94fe-eed5ffd7eda8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:55.845060 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-133053a5-cce2-4474-94fe-eed5ffd7eda8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:55.845501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-133053a5-cce2-4474-94fe-eed5ffd7eda8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:55.981640 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-133053a5-cce2-4474-94fe-eed5ffd7eda8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:55.989825 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-133053a5-cce2-4474-94fe-eed5ffd7eda8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.157745 Jul 28 18:08:55.990443 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 412/836] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:55 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:57.010918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-baaae7ca-d85e-46e0-99f4-a0c90618710e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:57.011586 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-baaae7ca-d85e-46e0-99f4-a0c90618710e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:57.018953 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-baaae7ca-d85e-46e0-99f4-a0c90618710e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:57.019406 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-baaae7ca-d85e-46e0-99f4-a0c90618710e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:57.020206 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-baaae7ca-d85e-46e0-99f4-a0c90618710e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:57.020649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-baaae7ca-d85e-46e0-99f4-a0c90618710e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:57.152349 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-baaae7ca-d85e-46e0-99f4-a0c90618710e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:57.159967 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-baaae7ca-d85e-46e0-99f4-a0c90618710e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.152948 Jul 28 18:08:57.160559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 413/837] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:57 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:57.210839 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-40d6bbde-6fe2-45d5-9e4d-6cdcdc2d9193 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.524021 Jul 28 18:08:57.211673 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 425/838] 10.222.0.85 () {62 vars in 1364 bytes} [Thu Jul 28 18:08:55 2022] POST /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/os-volume_attachments => generated 188 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 18:08:57.343867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7dee8f6d-1ddd-4512-964b-d7796afef334 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:57.344274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7dee8f6d-1ddd-4512-964b-d7796afef334 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:57.350672 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7dee8f6d-1ddd-4512-964b-d7796afef334 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:57.351119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7dee8f6d-1ddd-4512-964b-d7796afef334 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:57.351880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7dee8f6d-1ddd-4512-964b-d7796afef334 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:57.352313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7dee8f6d-1ddd-4512-964b-d7796afef334 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:58.182238 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cedc1511-da37-483e-9b6a-ac796f78ec41 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:58.182851 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cedc1511-da37-483e-9b6a-ac796f78ec41 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:58.189766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cedc1511-da37-483e-9b6a-ac796f78ec41 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:58.190206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cedc1511-da37-483e-9b6a-ac796f78ec41 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:58.191006 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cedc1511-da37-483e-9b6a-ac796f78ec41 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:58.191474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cedc1511-da37-483e-9b6a-ac796f78ec41 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:58.334572 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cedc1511-da37-483e-9b6a-ac796f78ec41 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:58.342271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cedc1511-da37-483e-9b6a-ac796f78ec41 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.164048 Jul 28 18:08:58.342870 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 426/839] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:58 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:08:58.496507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7dee8f6d-1ddd-4512-964b-d7796afef334 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/os-volume_attachments/9cf7ca6c-0203-4079-91f6-2759984de61f" status: 202 len: 0 microversion: 2.20 time: 1.156551 Jul 28 18:08:58.499463 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 414/840] 10.222.0.85 () {60 vars in 1457 bytes} [Thu Jul 28 18:08:57 2022] DELETE /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/os-volume_attachments/9cf7ca6c-0203-4079-91f6-2759984de61f => generated 0 bytes in 1158 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:08:58.563990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a5f122be-1945-4d3d-a5df-9ff8e5e36962 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:58.568390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a5f122be-1945-4d3d-a5df-9ff8e5e36962 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:58.573182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5f122be-1945-4d3d-a5df-9ff8e5e36962 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:58.573794 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5f122be-1945-4d3d-a5df-9ff8e5e36962 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:58.574904 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5f122be-1945-4d3d-a5df-9ff8e5e36962 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:58.575506 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5f122be-1945-4d3d-a5df-9ff8e5e36962 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:58.617681 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a5f122be-1945-4d3d-a5df-9ff8e5e36962 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130400) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 18:08:59.047262 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a5f122be-1945-4d3d-a5df-9ff8e5e36962 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "POST /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/action" status: 202 len: 0 microversion: 2.20 time: 0.489248 Jul 28 18:08:59.047996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 427/841] 10.222.0.85 () {62 vars in 1319 bytes} [Thu Jul 28 18:08:58 2022] POST /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/action => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:08:59.056078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:59.056693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:59.064423 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:59.064969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:59.065743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:59.066224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:59.213398 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:59.222721 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:59.224208 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:59.225363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0316f2e4-8080-488d-a340-c4e1d792810e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1671 microversion: 2.20 time: 0.173180 Jul 28 18:08:59.225996 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 415/842] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:08:59 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:08:59.364764 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-dddf4ec5-4db9-4af5-9329-78cccf4d8d36 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:08:59.365378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-dddf4ec5-4db9-4af5-9329-78cccf4d8d36 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:08:59.371425 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dddf4ec5-4db9-4af5-9329-78cccf4d8d36 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:59.372227 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dddf4ec5-4db9-4af5-9329-78cccf4d8d36 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:59.373602 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dddf4ec5-4db9-4af5-9329-78cccf4d8d36 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:59.373602 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dddf4ec5-4db9-4af5-9329-78cccf4d8d36 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:59.519825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-dddf4ec5-4db9-4af5-9329-78cccf4d8d36 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:08:59.528262 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-dddf4ec5-4db9-4af5-9329-78cccf4d8d36 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.167871 Jul 28 18:08:59.528935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 428/843] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:08:59 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:08:59.538523 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-9f101c93-53c2-451c-957b-93b5e76a39f7 req-2793d641-1347-4051-8e72-92a3d42b8379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875a9106-a56f-4acb-9056-7672341ebccc", "name": "network-vif-plugged", "status": "completed", "tag": "23f7eafd-8248-4438-9837-008bc6b5122c"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:08:59.548456 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-9f101c93-53c2-451c-957b-93b5e76a39f7 req-2793d641-1347-4051-8e72-92a3d42b8379 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:08:59.548902 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-9f101c93-53c2-451c-957b-93b5e76a39f7 req-2793d641-1347-4051-8e72-92a3d42b8379 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:08:59.560372 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-9f101c93-53c2-451c-957b-93b5e76a39f7 req-2793d641-1347-4051-8e72-92a3d42b8379 service nova] Creating event network-vif-plugged:23f7eafd-8248-4438-9837-008bc6b5122c for instance 875a9106-a56f-4acb-9056-7672341ebccc on hv-cinder-83754 Jul 28 18:08:59.566085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-9f101c93-53c2-451c-957b-93b5e76a39f7 req-2793d641-1347-4051-8e72-92a3d42b8379 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031563 Jul 28 18:08:59.566866 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 416/844] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:09:00.249226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:00.249833 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:00.256656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:00.257115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:00.257882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:00.258317 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:00.395309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:00.403753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:00.405247 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:00.406568 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5e1026d3-2ad6-4723-8ef8-5005fff9f860 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1671 microversion: 2.20 time: 0.161210 Jul 28 18:09:00.407150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 429/845] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:00 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:00.549989 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-85819096-6d03-4456-8c69-87c59dd24f07 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:00.555228 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-85819096-6d03-4456-8c69-87c59dd24f07 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:00.557078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-85819096-6d03-4456-8c69-87c59dd24f07 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:00.557526 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-85819096-6d03-4456-8c69-87c59dd24f07 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:00.558303 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-85819096-6d03-4456-8c69-87c59dd24f07 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:00.558769 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-85819096-6d03-4456-8c69-87c59dd24f07 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:00.693010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-85819096-6d03-4456-8c69-87c59dd24f07 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:00.700244 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-85819096-6d03-4456-8c69-87c59dd24f07 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1363 microversion: 2.1 time: 0.154997 Jul 28 18:09:00.700804 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 417/846] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:00 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:01.429654 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:01.430299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:01.432554 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:01.437523 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:01.438004 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:01.438978 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:01.439450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:01.576560 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:01.586280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:01.587921 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:01.589084 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b1038c37-14b5-400f-97c3-400113fe8110 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1673 microversion: 2.20 time: 0.163625 Jul 28 18:09:01.589662 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 430/847] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:01 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:01.721973 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8bf5f662-f4ce-4a5b-befa-5c9b7db0b349 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:01.722539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8bf5f662-f4ce-4a5b-befa-5c9b7db0b349 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:01.724971 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=62 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:01.730286 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8bf5f662-f4ce-4a5b-befa-5c9b7db0b349 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:01.730786 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8bf5f662-f4ce-4a5b-befa-5c9b7db0b349 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:01.731592 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8bf5f662-f4ce-4a5b-befa-5c9b7db0b349 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:01.732037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8bf5f662-f4ce-4a5b-befa-5c9b7db0b349 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:01.747092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:01.870658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8bf5f662-f4ce-4a5b-befa-5c9b7db0b349 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:01.878639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8bf5f662-f4ce-4a5b-befa-5c9b7db0b349 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1548 microversion: 2.1 time: 0.160917 Jul 28 18:09:01.879204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 418/848] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:01 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:01.899441 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7c60647f-b3fa-4ec3-97f2-b26115c9e3f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:01.903667 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7c60647f-b3fa-4ec3-97f2-b26115c9e3f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:01.906573 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c60647f-b3fa-4ec3-97f2-b26115c9e3f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:01.907020 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c60647f-b3fa-4ec3-97f2-b26115c9e3f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:01.907903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c60647f-b3fa-4ec3-97f2-b26115c9e3f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:01.908553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c60647f-b3fa-4ec3-97f2-b26115c9e3f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:01.991050 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7c60647f-b3fa-4ec3-97f2-b26115c9e3f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093405 Jul 28 18:09:01.991710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 431/849] 10.222.0.85 () {58 vars in 1275 bytes} [Thu Jul 28 18:09:01 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:09:02.615622 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:02.617834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:02.630563 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:02.631067 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:02.631829 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:02.632271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:02.873377 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:02.889176 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:02.890914 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:02.892301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-93ca93e3-1be8-48dd-a7c5-b5bfde8dd10a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.281137 Jul 28 18:09:02.893874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 419/850] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:02 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:03.774390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-cfab0991-d431-4fba-b8e5-b6beb3fc4994 req-fed8730b-af49-4bc5-be6e-149e0e78a064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875a9106-a56f-4acb-9056-7672341ebccc", "tag": "23f7eafd-8248-4438-9837-008bc6b5122c"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:03.784711 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-cfab0991-d431-4fba-b8e5-b6beb3fc4994 req-fed8730b-af49-4bc5-be6e-149e0e78a064 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:03.785515 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-cfab0991-d431-4fba-b8e5-b6beb3fc4994 req-fed8730b-af49-4bc5-be6e-149e0e78a064 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:03.797872 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-cfab0991-d431-4fba-b8e5-b6beb3fc4994 req-fed8730b-af49-4bc5-be6e-149e0e78a064 service nova] Creating event network-changed:23f7eafd-8248-4438-9837-008bc6b5122c for instance 875a9106-a56f-4acb-9056-7672341ebccc on hv-cinder-83754 Jul 28 18:09:03.803391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-cfab0991-d431-4fba-b8e5-b6beb3fc4994 req-fed8730b-af49-4bc5-be6e-149e0e78a064 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033114 Jul 28 18:09:03.803982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 432/851] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:09:03.925258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:03.925980 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:03.932808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:03.933258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:03.934050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:03.934559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:04.073841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:04.082559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:04.084047 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:04.085295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-43b87192-b68e-457a-87d5-d9029bcb3b10 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.172184 Jul 28 18:09:04.085862 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 420/852] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:03 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:05.111656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:05.112565 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:05.119524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:05.120247 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:05.121162 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:05.121768 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:05.405850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:05.418325 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:05.420580 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:05.422402 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d143a021-b630-4942-9d37-adec92789307 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.316671 Jul 28 18:09:05.423318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 433/853] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:05 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:06.447610 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:06.448899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:06.459770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:06.459770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:06.463340 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:06.466152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:06.646110 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:06.654198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:06.655796 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:06.656957 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0f05477e-4ecd-43c3-aa85-8a04c3e9885d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.214800 Jul 28 18:09:06.658294 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 421/854] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:06 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:07.683172 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:07.684713 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:07.693109 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:07.693554 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:07.694416 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:07.694941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:07.841986 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:07.845600 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:07.850945 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:07.852697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:07.854088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-dfd90c49-88a1-4361-ac97-fa4013bc184e tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.175419 Jul 28 18:09:07.855151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 434/855] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:07 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:08.882792 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:08.883617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:08.890647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:08.891190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:08.891995 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:08.892427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:09.052141 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:09.060620 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:09.062114 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:09.063333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ea8527d2-1605-4bc0-abfc-a0f37532c647 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.188826 Jul 28 18:09:09.064110 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 422/856] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:08 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:10.089026 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:10.089425 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:10.097185 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:10.097627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:10.098952 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:10.099710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:10.243418 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:10.253163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:10.256788 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:10.257875 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ac16f7e5-521f-4eb7-8caf-393b5802454a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.174122 Jul 28 18:09:10.258956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 435/857] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:10 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:09:10.880089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1589cf91-3837-4f3d-b3f8-33fc52e7e5a9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:10.880636 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1589cf91-3837-4f3d-b3f8-33fc52e7e5a9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:10.887808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1589cf91-3837-4f3d-b3f8-33fc52e7e5a9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:10.888785 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1589cf91-3837-4f3d-b3f8-33fc52e7e5a9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:10.889817 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1589cf91-3837-4f3d-b3f8-33fc52e7e5a9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:10.890514 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1589cf91-3837-4f3d-b3f8-33fc52e7e5a9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:11.077184 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1589cf91-3837-4f3d-b3f8-33fc52e7e5a9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:09:11.284487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:11.285192 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:11.298295 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:11.298925 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:11.299868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:11.300356 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:11.481072 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:11.492181 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:11.494059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:11.495627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ef3971bb-d76d-4603-bb17-5fcf3aa983a0 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.216002 Jul 28 18:09:11.496505 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 436/858] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:11 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:09:11.930367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1589cf91-3837-4f3d-b3f8-33fc52e7e5a9 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 204 len: 0 microversion: 2.1 time: 1.054069 Jul 28 18:09:11.931192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 423/859] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:09:10 2022] DELETE /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:09:11.940705 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-22b8862d-0079-4ec2-ba15-81cbc4eb64b0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:11.945240 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-22b8862d-0079-4ec2-ba15-81cbc4eb64b0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:11.947569 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-22b8862d-0079-4ec2-ba15-81cbc4eb64b0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:11.948018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-22b8862d-0079-4ec2-ba15-81cbc4eb64b0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:11.948791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-22b8862d-0079-4ec2-ba15-81cbc4eb64b0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:11.949222 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-22b8862d-0079-4ec2-ba15-81cbc4eb64b0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:12.118436 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-22b8862d-0079-4ec2-ba15-81cbc4eb64b0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:12.126403 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-22b8862d-0079-4ec2-ba15-81cbc4eb64b0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1577 microversion: 2.1 time: 0.190334 Jul 28 18:09:12.127620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 437/860] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:11 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:12.523947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:12.524648 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:12.530691 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:12.531134 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:12.532008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:12.532951 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:12.669545 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:12.678717 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:12.680213 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:12.681386 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2a1fc96e-a8e7-404d-9e6e-8177dd2b64ad tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.161761 Jul 28 18:09:12.681970 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 424/861] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:12 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:13.148682 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-376b4779-a9c6-431a-809b-5e35b051396b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:13.149348 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-376b4779-a9c6-431a-809b-5e35b051396b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:13.156046 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-376b4779-a9c6-431a-809b-5e35b051396b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:13.156485 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-376b4779-a9c6-431a-809b-5e35b051396b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:13.158036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-376b4779-a9c6-431a-809b-5e35b051396b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:13.158532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-376b4779-a9c6-431a-809b-5e35b051396b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:13.296707 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-376b4779-a9c6-431a-809b-5e35b051396b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:13.304716 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-376b4779-a9c6-431a-809b-5e35b051396b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1577 microversion: 2.1 time: 0.159798 Jul 28 18:09:13.305285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 438/862] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:13 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:13.705819 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:13.706460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:13.713019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:13.713479 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:13.714246 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:13.714834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:13.846670 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:13.854830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:13.856326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:13.857483 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bf979a33-f39a-4a89-a652-5630d18708ae tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.156313 Jul 28 18:09:13.858025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 425/863] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:13 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:14.325947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7e22229b-c8ee-4e5b-9557-83dd18cf5a8d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:14.326807 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7e22229b-c8ee-4e5b-9557-83dd18cf5a8d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:14.333542 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7e22229b-c8ee-4e5b-9557-83dd18cf5a8d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:14.333984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7e22229b-c8ee-4e5b-9557-83dd18cf5a8d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:14.334777 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7e22229b-c8ee-4e5b-9557-83dd18cf5a8d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:14.335246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7e22229b-c8ee-4e5b-9557-83dd18cf5a8d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:14.468270 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7e22229b-c8ee-4e5b-9557-83dd18cf5a8d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:14.476657 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7e22229b-c8ee-4e5b-9557-83dd18cf5a8d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1577 microversion: 2.1 time: 0.154511 Jul 28 18:09:14.477234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 439/864] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:14 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:14.881056 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:14.881668 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:14.892149 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:14.892149 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:14.892149 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:14.892149 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:15.021338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:15.029504 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:15.031067 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:15.032310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-afe81aef-c349-44b5-904c-168e96b7df1c tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.155121 Jul 28 18:09:15.032834 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 426/865] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:14 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:15.499156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e3e105df-5905-45ba-afcd-250fe461edc0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:15.500050 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e3e105df-5905-45ba-afcd-250fe461edc0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:15.507398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e3e105df-5905-45ba-afcd-250fe461edc0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:15.508129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e3e105df-5905-45ba-afcd-250fe461edc0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:15.509182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e3e105df-5905-45ba-afcd-250fe461edc0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:15.509674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e3e105df-5905-45ba-afcd-250fe461edc0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:15.759024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e3e105df-5905-45ba-afcd-250fe461edc0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:15.767269 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e3e105df-5905-45ba-afcd-250fe461edc0 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1577 microversion: 2.1 time: 0.271941 Jul 28 18:09:15.768578 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 440/866] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:15 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1577 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:16.055696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:16.056316 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:16.062395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:16.062854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:16.064248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:16.064692 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:16.201295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:16.209714 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:16.211336 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:16.212501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bb9d07af-ae97-4354-b621-2170849511f5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.161244 Jul 28 18:09:16.213052 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 427/867] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:16 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:16.542773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-171600a9-0f91-495c-aa10-99f99463e67a req-ded67fc6-4f39-4df4-91da-ed2abf39ba20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f1642e2-8e19-4214-8ada-503d731de538", "name": "network-vif-deleted", "tag": "e04a6944-3588-4a0b-9a97-45eafc96eeed"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:16.554005 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-171600a9-0f91-495c-aa10-99f99463e67a req-ded67fc6-4f39-4df4-91da-ed2abf39ba20 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:16.554470 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-171600a9-0f91-495c-aa10-99f99463e67a req-ded67fc6-4f39-4df4-91da-ed2abf39ba20 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:16.567789 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-171600a9-0f91-495c-aa10-99f99463e67a req-ded67fc6-4f39-4df4-91da-ed2abf39ba20 service nova] Creating event network-vif-deleted:e04a6944-3588-4a0b-9a97-45eafc96eeed for instance 1f1642e2-8e19-4214-8ada-503d731de538 on hv-cinder-83754 Jul 28 18:09:16.575152 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-171600a9-0f91-495c-aa10-99f99463e67a req-ded67fc6-4f39-4df4-91da-ed2abf39ba20 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035702 Jul 28 18:09:16.576083 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 441/868] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:09:16.793244 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d6fcaf2d-35b6-4c42-b2ca-03aea6d53a2d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:16.793244 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d6fcaf2d-35b6-4c42-b2ca-03aea6d53a2d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:16.796808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d6fcaf2d-35b6-4c42-b2ca-03aea6d53a2d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:16.797261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d6fcaf2d-35b6-4c42-b2ca-03aea6d53a2d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:16.798813 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d6fcaf2d-35b6-4c42-b2ca-03aea6d53a2d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:16.799205 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d6fcaf2d-35b6-4c42-b2ca-03aea6d53a2d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:16.870480 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d6fcaf2d-35b6-4c42-b2ca-03aea6d53a2d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:16.878426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d6fcaf2d-35b6-4c42-b2ca-03aea6d53a2d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1509 microversion: 2.1 time: 0.092794 Jul 28 18:09:16.878989 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 428/869] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:16 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1509 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:17.237909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:17.238743 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:17.245226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:17.245748 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:17.246674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:17.247175 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:17.411332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:17.424624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:17.426465 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:17.427643 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d6d35fae-999e-4a81-b12b-84892d1f7e5b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.194353 Jul 28 18:09:17.428190 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 442/870] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:17 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:17.527910 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-c6fbc084-55e1-4ef6-831b-7fc9d4f45eb2 req-236b62fd-8724-48ea-910e-8474ebcb1139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ad8548-670a-4120-9652-2c63a78dd575", "name": "network-vif-plugged", "status": "completed", "tag": "7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:17.539926 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-c6fbc084-55e1-4ef6-831b-7fc9d4f45eb2 req-236b62fd-8724-48ea-910e-8474ebcb1139 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:17.540964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-c6fbc084-55e1-4ef6-831b-7fc9d4f45eb2 req-236b62fd-8724-48ea-910e-8474ebcb1139 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:17.554738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-c6fbc084-55e1-4ef6-831b-7fc9d4f45eb2 req-236b62fd-8724-48ea-910e-8474ebcb1139 service nova] Creating event network-vif-plugged:7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1 for instance b6ad8548-670a-4120-9652-2c63a78dd575 on hv-cinder-83754 Jul 28 18:09:17.560067 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-c6fbc084-55e1-4ef6-831b-7fc9d4f45eb2 req-236b62fd-8724-48ea-910e-8474ebcb1139 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036217 Jul 28 18:09:17.560635 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 429/871] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:09:17.902976 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d5d5b93e-3ec5-4101-8b1a-e3c57bf8ae5a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:17.904408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d5d5b93e-3ec5-4101-8b1a-e3c57bf8ae5a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:17.911924 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5d5b93e-3ec5-4101-8b1a-e3c57bf8ae5a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:17.915766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5d5b93e-3ec5-4101-8b1a-e3c57bf8ae5a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:17.915766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5d5b93e-3ec5-4101-8b1a-e3c57bf8ae5a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:17.915766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d5d5b93e-3ec5-4101-8b1a-e3c57bf8ae5a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:17.997266 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d5d5b93e-3ec5-4101-8b1a-e3c57bf8ae5a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:18.006282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d5d5b93e-3ec5-4101-8b1a-e3c57bf8ae5a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1226 microversion: 2.1 time: 0.107245 Jul 28 18:09:18.007370 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 443/872] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:17 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:18.450329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:18.451070 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:18.457591 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:18.458032 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:18.458812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:18.459248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:18.599717 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:18.608428 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:18.610040 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:18.611240 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-833f9eb8-cc47-4af0-a0ff-4b526591e5cc tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.165138 Jul 28 18:09:18.611790 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 430/873] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:18 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:19.027287 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:19.027873 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:19.034693 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:19.035140 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:19.035894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:19.036325 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:19.067903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:19.068351 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:19.068797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lazy-loading 'fault' on Instance uuid 1f1642e2-8e19-4214-8ada-503d731de538 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:09:19.119721 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:19.127866 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-67596ff7-b1d5-4cec-bedd-f9165e2981d4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 200 len: 1231 microversion: 2.1 time: 0.104372 Jul 28 18:09:19.128426 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 444/874] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:19 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 1231 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:19.634565 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:19.635183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:19.641629 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:19.642289 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:19.643121 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:19.643565 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:19.786686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:19.795228 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:19.796808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:19.799063 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2e68c499-ea31-41db-8c5f-712a8b754cbd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.168440 Jul 28 18:09:19.799699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 431/875] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:19 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:20.153165 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:20.153767 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:20.161362 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:20.162528 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:20.163410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:20.163789 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:20.178405 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] HTTP exception thrown: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Request method failure captured: Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 HTTP/1.1 Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s_AXY_VHHcQahsxAU5bJ_e-A0sMj1nvn58EMe-BEXKOAUFRRxtXJImp79cmOZMhi4ncJ4oEFCRueyM5r84ougYMgq4s5MY5FJb4WXpn8R8ozOiiccb-OGRTQ4h7Qjb34RY7_7p0hnqOkp_mnqPyt72qxKKQV8winW6KuSZu2pFkNKw Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:09:20.180062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a1b1e6abd55a4b17b4a452a80a6bbdbc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 73edfd05da254457b6ad9c9c9f662e4c Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:09:20.181697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '1f1642e2-8e19-4214-8ada-503d731de538'} Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:09:20.182581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:09:20.183908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:09:20.185059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Returning 404 to user: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:09:20.185059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-abce2126-ea03-4964-aa99-2516bb632858 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 404 len: 111 microversion: 2.1 time: 0.032522 Jul 28 18:09:20.185059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 445/876] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:20 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:09:20.288832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-105618390", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1518406974", "security_groups": [{"name": "tempest-secgroup-smoke-1342836541"}], "block_device_mapping_v2": [{"uuid": "907fd795-415c-440b-8945-e8148fd7978b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2745d657-8db7-4817-b0a4-814cddf7a093"}]}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:20.420984 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.network.neutron [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] validate_networks() for [('2745d657-8db7-4817-b0a4-814cddf7a093', None, None, None, None, None)] {{(pid=130401) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:09:20.822898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:20.824114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:20.832053 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:20.832634 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:20.833696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:20.834230 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:20.950204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Flavor limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:09:20.950867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Image limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:09:20.951160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Flavor pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:09:20.951571 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Image pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:09:20.951986 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:09:20.962703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:20.963166 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:20.963990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:20.964433 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:20.982444 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:20.989903 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Getting quotas for project a1b1e6abd55a4b17b4a452a80a6bbdbc. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:09:20.991677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:20.993386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:20.994600 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f7b59846-504b-45f8-a401-331d42bf879a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1729 microversion: 2.20 time: 0.175672 Jul 28 18:09:20.995361 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 446/877] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:20 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 18:09:20.996695 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Getting quotas for user 73edfd05da254457b6ad9c9c9f662e4c and project a1b1e6abd55a4b17b4a452a80a6bbdbc. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:09:21.074312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Going to run 1 instances... {{(pid=130401) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:09:21.077816 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='907fd795-415c-440b-8945-e8148fd7978b',volume_size=None,volume_type=None)] {{(pid=130401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:09:21.540135 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-975ae2ab-7adf-4e61-9558-87149ec006d8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.255073 Jul 28 18:09:21.540776 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 432/878] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:09:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:09:21.552460 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5225cdeb-324c-4697-8d4f-5649ccdd73d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:21.553127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5225cdeb-324c-4697-8d4f-5649ccdd73d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:21.619865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5225cdeb-324c-4697-8d4f-5649ccdd73d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:21.627897 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5225cdeb-324c-4697-8d4f-5649ccdd73d2 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1094 microversion: 2.1 time: 0.079497 Jul 28 18:09:21.628599 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 447/879] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:21 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:22.042912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:22.042912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:22.044175 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:22.044175 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:22.044501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:22.044941 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:22.194886 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:22.202873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:22.204419 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:22.205640 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7f338394-f43b-4452-aef6-aade0df6fdd5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1716 microversion: 2.20 time: 0.174224 Jul 28 18:09:22.206196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 433/880] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:22 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1716 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:22.649403 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6ac6451b-11ee-4ad9-af45-3d4a63a8f33f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:22.650022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6ac6451b-11ee-4ad9-af45-3d4a63a8f33f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:22.658392 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6ac6451b-11ee-4ad9-af45-3d4a63a8f33f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:22.658831 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6ac6451b-11ee-4ad9-af45-3d4a63a8f33f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:22.659636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6ac6451b-11ee-4ad9-af45-3d4a63a8f33f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:22.660070 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6ac6451b-11ee-4ad9-af45-3d4a63a8f33f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:22.726761 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6ac6451b-11ee-4ad9-af45-3d4a63a8f33f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:22.736341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6ac6451b-11ee-4ad9-af45-3d4a63a8f33f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1144 microversion: 2.1 time: 0.090849 Jul 28 18:09:22.742033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 448/881] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:22 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:23.757978 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-98333679-0534-49ca-b707-1bf522dd5e22 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:23.758705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-98333679-0534-49ca-b707-1bf522dd5e22 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:23.765438 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-98333679-0534-49ca-b707-1bf522dd5e22 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:23.765946 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-98333679-0534-49ca-b707-1bf522dd5e22 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:23.766949 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-98333679-0534-49ca-b707-1bf522dd5e22 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:23.767399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-98333679-0534-49ca-b707-1bf522dd5e22 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:23.831357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-98333679-0534-49ca-b707-1bf522dd5e22 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:23.833664 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:23.840022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-98333679-0534-49ca-b707-1bf522dd5e22 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1200 microversion: 2.1 time: 0.086267 Jul 28 18:09:23.841339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 434/882] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:23 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1200 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:24.867742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6e34ab73-c325-44a8-b8db-6d97cd28ed3f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:24.870548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6e34ab73-c325-44a8-b8db-6d97cd28ed3f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:24.875642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6e34ab73-c325-44a8-b8db-6d97cd28ed3f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:24.877280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6e34ab73-c325-44a8-b8db-6d97cd28ed3f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:24.877280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6e34ab73-c325-44a8-b8db-6d97cd28ed3f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:24.878485 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6e34ab73-c325-44a8-b8db-6d97cd28ed3f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:25.034755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6e34ab73-c325-44a8-b8db-6d97cd28ed3f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:25.042392 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6e34ab73-c325-44a8-b8db-6d97cd28ed3f tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1278 microversion: 2.1 time: 0.178565 Jul 28 18:09:25.042969 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 449/883] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:24 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:25.470385 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-dd896db8-c72d-4a2f-8f4f-e6f732b1591b req-cdcc374a-319d-4aff-83e3-5d7edc448418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee5c512-be6b-4ace-a719-1111bf9781be", "tag": "865b74cb-5e80-4ef5-a157-9e8ba6c62279"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:25.475175 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-dd896db8-c72d-4a2f-8f4f-e6f732b1591b req-cdcc374a-319d-4aff-83e3-5d7edc448418 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:25.475780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-dd896db8-c72d-4a2f-8f4f-e6f732b1591b req-cdcc374a-319d-4aff-83e3-5d7edc448418 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:25.489833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-dd896db8-c72d-4a2f-8f4f-e6f732b1591b req-cdcc374a-319d-4aff-83e3-5d7edc448418 service nova] Creating event network-changed:865b74cb-5e80-4ef5-a157-9e8ba6c62279 for instance 3ee5c512-be6b-4ace-a719-1111bf9781be on hv-cinder-83754 Jul 28 18:09:25.501485 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-dd896db8-c72d-4a2f-8f4f-e6f732b1591b req-cdcc374a-319d-4aff-83e3-5d7edc448418 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045074 Jul 28 18:09:25.504074 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 435/884] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:09:25.940080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3d274e9b-37b5-41ff-b054-b8dc393c56a1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:25.940646 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3d274e9b-37b5-41ff-b054-b8dc393c56a1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:25.947480 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3d274e9b-37b5-41ff-b054-b8dc393c56a1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:25.947932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3d274e9b-37b5-41ff-b054-b8dc393c56a1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:25.948715 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3d274e9b-37b5-41ff-b054-b8dc393c56a1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:25.949153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3d274e9b-37b5-41ff-b054-b8dc393c56a1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:25.973482 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-3d274e9b-37b5-41ff-b054-b8dc393c56a1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lazy-loading 'flavor' on Instance uuid 08e56a37-546f-4aa0-a30d-7e0108b17796 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:09:26.068811 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5de74410-d2ba-47a9-9029-f13aa5f7e8bc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:26.069496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5de74410-d2ba-47a9-9029-f13aa5f7e8bc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:26.076319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5de74410-d2ba-47a9-9029-f13aa5f7e8bc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:26.076763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5de74410-d2ba-47a9-9029-f13aa5f7e8bc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:26.077561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5de74410-d2ba-47a9-9029-f13aa5f7e8bc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:26.078021 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5de74410-d2ba-47a9-9029-f13aa5f7e8bc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:26.215820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5de74410-d2ba-47a9-9029-f13aa5f7e8bc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:26.225344 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5de74410-d2ba-47a9-9029-f13aa5f7e8bc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.161328 Jul 28 18:09:26.225925 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 436/885] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:26 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:26.323259 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3d274e9b-37b5-41ff-b054-b8dc393c56a1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "POST /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796/action" status: 202 len: 0 microversion: 2.1 time: 0.387805 Jul 28 18:09:26.323882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 450/886] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:09:25 2022] POST /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:09:26.333014 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-01ff13b6-c145-495b-b8da-1923a9fb591f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:26.340900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-01ff13b6-c145-495b-b8da-1923a9fb591f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:26.340900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-01ff13b6-c145-495b-b8da-1923a9fb591f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:26.340900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-01ff13b6-c145-495b-b8da-1923a9fb591f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:26.341458 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-01ff13b6-c145-495b-b8da-1923a9fb591f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:26.341458 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-01ff13b6-c145-495b-b8da-1923a9fb591f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:26.483146 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-01ff13b6-c145-495b-b8da-1923a9fb591f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:26.492019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-01ff13b6-c145-495b-b8da-1923a9fb591f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.163431 Jul 28 18:09:26.492601 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 437/887] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:26 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:27.257637 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0ea063c6-776d-4da5-a68f-dbd04adf6070 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:27.258336 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0ea063c6-776d-4da5-a68f-dbd04adf6070 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:27.264554 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ea063c6-776d-4da5-a68f-dbd04adf6070 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:27.265004 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ea063c6-776d-4da5-a68f-dbd04adf6070 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:27.266529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ea063c6-776d-4da5-a68f-dbd04adf6070 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:27.266977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ea063c6-776d-4da5-a68f-dbd04adf6070 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:27.301793 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:27.400282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0ea063c6-776d-4da5-a68f-dbd04adf6070 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:27.408880 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0ea063c6-776d-4da5-a68f-dbd04adf6070 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.156051 Jul 28 18:09:27.409442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 451/888] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:27 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:27.513013 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fa2c01dd-7875-4c4e-9717-8e49660c54a8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:27.513621 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-fa2c01dd-7875-4c4e-9717-8e49660c54a8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:27.520491 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fa2c01dd-7875-4c4e-9717-8e49660c54a8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:27.520945 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fa2c01dd-7875-4c4e-9717-8e49660c54a8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:27.521712 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fa2c01dd-7875-4c4e-9717-8e49660c54a8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:27.522149 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fa2c01dd-7875-4c4e-9717-8e49660c54a8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:27.657981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-fa2c01dd-7875-4c4e-9717-8e49660c54a8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:27.665599 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fa2c01dd-7875-4c4e-9717-8e49660c54a8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.156436 Jul 28 18:09:27.666165 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 438/889] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:27 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:28.430710 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-adb22cd2-33e9-47d2-9a87-3b26e9653058 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:28.431374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-adb22cd2-33e9-47d2-9a87-3b26e9653058 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:28.439080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-adb22cd2-33e9-47d2-9a87-3b26e9653058 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:28.439502 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-adb22cd2-33e9-47d2-9a87-3b26e9653058 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:28.440280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-adb22cd2-33e9-47d2-9a87-3b26e9653058 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:28.440745 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-adb22cd2-33e9-47d2-9a87-3b26e9653058 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:28.588740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-adb22cd2-33e9-47d2-9a87-3b26e9653058 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:28.597288 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-adb22cd2-33e9-47d2-9a87-3b26e9653058 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.170634 Jul 28 18:09:28.597855 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 452/890] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:28 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:28.687990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b8dd27cf-df69-45ef-b05c-671c94123abf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:28.688539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b8dd27cf-df69-45ef-b05c-671c94123abf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:28.695000 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b8dd27cf-df69-45ef-b05c-671c94123abf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:28.698058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b8dd27cf-df69-45ef-b05c-671c94123abf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:28.698058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b8dd27cf-df69-45ef-b05c-671c94123abf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:28.698058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b8dd27cf-df69-45ef-b05c-671c94123abf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:28.827491 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b8dd27cf-df69-45ef-b05c-671c94123abf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:28.835261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b8dd27cf-df69-45ef-b05c-671c94123abf tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.151552 Jul 28 18:09:28.835820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 439/891] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:28 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:29.619716 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bb96ce04-a3c8-4df9-8aa4-2b751ea5a7f6 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:29.620327 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bb96ce04-a3c8-4df9-8aa4-2b751ea5a7f6 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:29.627503 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bb96ce04-a3c8-4df9-8aa4-2b751ea5a7f6 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:29.627950 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bb96ce04-a3c8-4df9-8aa4-2b751ea5a7f6 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:29.628722 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bb96ce04-a3c8-4df9-8aa4-2b751ea5a7f6 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:29.629152 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bb96ce04-a3c8-4df9-8aa4-2b751ea5a7f6 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:29.768528 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bb96ce04-a3c8-4df9-8aa4-2b751ea5a7f6 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:29.776045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bb96ce04-a3c8-4df9-8aa4-2b751ea5a7f6 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.160233 Jul 28 18:09:29.776603 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 453/892] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:29 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:29.857313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-34234047-56e8-4590-91f7-ebb843e5334e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:29.857947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-34234047-56e8-4590-91f7-ebb843e5334e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:29.865210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34234047-56e8-4590-91f7-ebb843e5334e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:29.865649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34234047-56e8-4590-91f7-ebb843e5334e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:29.866426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34234047-56e8-4590-91f7-ebb843e5334e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:29.866861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-34234047-56e8-4590-91f7-ebb843e5334e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:30.002458 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-34234047-56e8-4590-91f7-ebb843e5334e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:30.010218 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-34234047-56e8-4590-91f7-ebb843e5334e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.157040 Jul 28 18:09:30.010810 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 440/893] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:29 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:30.795754 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f2f20b26-29f7-4846-a091-cb0e79341d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:30.796411 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f2f20b26-29f7-4846-a091-cb0e79341d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:30.803097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f2f20b26-29f7-4846-a091-cb0e79341d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:30.803545 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f2f20b26-29f7-4846-a091-cb0e79341d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:30.804309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f2f20b26-29f7-4846-a091-cb0e79341d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:30.804770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f2f20b26-29f7-4846-a091-cb0e79341d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:30.934016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f2f20b26-29f7-4846-a091-cb0e79341d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:30.942546 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f2f20b26-29f7-4846-a091-cb0e79341d47 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.150562 Jul 28 18:09:30.954761 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 454/894] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:30 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:31.032255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f65a6816-404a-4a49-819f-bb9300779541 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:31.032931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f65a6816-404a-4a49-819f-bb9300779541 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:31.035366 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:31.036033 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=6 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:31.040764 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f65a6816-404a-4a49-819f-bb9300779541 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:31.041215 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f65a6816-404a-4a49-819f-bb9300779541 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:31.041981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f65a6816-404a-4a49-819f-bb9300779541 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:31.042441 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f65a6816-404a-4a49-819f-bb9300779541 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:31.179431 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f65a6816-404a-4a49-819f-bb9300779541 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:31.187146 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f65a6816-404a-4a49-819f-bb9300779541 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.159248 Jul 28 18:09:31.188326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 441/895] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:31 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:31.964298 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-552dbbc3-5524-4968-b3d3-ee9aecb96c41 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:31.964930 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-552dbbc3-5524-4968-b3d3-ee9aecb96c41 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:31.966791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:31.967930 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=54 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:31.973482 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-552dbbc3-5524-4968-b3d3-ee9aecb96c41 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:31.973922 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-552dbbc3-5524-4968-b3d3-ee9aecb96c41 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:31.974698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-552dbbc3-5524-4968-b3d3-ee9aecb96c41 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:31.975126 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-552dbbc3-5524-4968-b3d3-ee9aecb96c41 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:32.113237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-552dbbc3-5524-4968-b3d3-ee9aecb96c41 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:32.120643 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-552dbbc3-5524-4968-b3d3-ee9aecb96c41 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.160186 Jul 28 18:09:32.121202 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 455/896] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:31 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:32.209895 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-07c8d07f-b662-4e24-a855-b0975bf24317 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:32.210527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-07c8d07f-b662-4e24-a855-b0975bf24317 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:32.212804 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:32.220394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-07c8d07f-b662-4e24-a855-b0975bf24317 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:32.220394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-07c8d07f-b662-4e24-a855-b0975bf24317 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:32.220394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-07c8d07f-b662-4e24-a855-b0975bf24317 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:32.220394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-07c8d07f-b662-4e24-a855-b0975bf24317 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:32.357552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-07c8d07f-b662-4e24-a855-b0975bf24317 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:32.365865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-07c8d07f-b662-4e24-a855-b0975bf24317 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.159871 Jul 28 18:09:32.366440 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 442/897] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:32 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:33.141140 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-89b2ac3b-3940-4087-9cec-82c9820207fc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:33.141737 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-89b2ac3b-3940-4087-9cec-82c9820207fc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:33.148334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-89b2ac3b-3940-4087-9cec-82c9820207fc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:33.148771 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-89b2ac3b-3940-4087-9cec-82c9820207fc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:33.149555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-89b2ac3b-3940-4087-9cec-82c9820207fc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:33.149982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-89b2ac3b-3940-4087-9cec-82c9820207fc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:33.283751 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-89b2ac3b-3940-4087-9cec-82c9820207fc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:33.291222 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-89b2ac3b-3940-4087-9cec-82c9820207fc tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.153895 Jul 28 18:09:33.291790 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 456/898] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:33 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:33.387448 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-76144e47-4aec-4417-90e3-e5cffdcb704c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:33.388022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-76144e47-4aec-4417-90e3-e5cffdcb704c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:33.395472 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-76144e47-4aec-4417-90e3-e5cffdcb704c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:33.395918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-76144e47-4aec-4417-90e3-e5cffdcb704c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:33.396680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-76144e47-4aec-4417-90e3-e5cffdcb704c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:33.397115 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-76144e47-4aec-4417-90e3-e5cffdcb704c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:33.532076 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-76144e47-4aec-4417-90e3-e5cffdcb704c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:33.540473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-76144e47-4aec-4417-90e3-e5cffdcb704c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.157003 Jul 28 18:09:33.541037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 443/899] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:33 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:34.311390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b68f352d-f44b-4876-8716-507d2910ac49 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:34.312068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b68f352d-f44b-4876-8716-507d2910ac49 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:34.319251 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b68f352d-f44b-4876-8716-507d2910ac49 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:34.319704 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b68f352d-f44b-4876-8716-507d2910ac49 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:34.320474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b68f352d-f44b-4876-8716-507d2910ac49 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:34.320910 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b68f352d-f44b-4876-8716-507d2910ac49 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:34.453483 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b68f352d-f44b-4876-8716-507d2910ac49 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:34.461280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b68f352d-f44b-4876-8716-507d2910ac49 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.153753 Jul 28 18:09:34.466835 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 457/900] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:34 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:34.561760 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d05261db-8b66-4081-a7f6-749d8792ed9d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:34.562290 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d05261db-8b66-4081-a7f6-749d8792ed9d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:34.569592 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d05261db-8b66-4081-a7f6-749d8792ed9d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:34.570045 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d05261db-8b66-4081-a7f6-749d8792ed9d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:34.570855 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d05261db-8b66-4081-a7f6-749d8792ed9d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:34.571297 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d05261db-8b66-4081-a7f6-749d8792ed9d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:34.708841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d05261db-8b66-4081-a7f6-749d8792ed9d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:34.716900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d05261db-8b66-4081-a7f6-749d8792ed9d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.159154 Jul 28 18:09:34.718924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 444/901] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:34 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:35.483170 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bb1e75da-8342-4f42-852a-98dcdc3af8b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:35.483783 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bb1e75da-8342-4f42-852a-98dcdc3af8b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:35.490723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bb1e75da-8342-4f42-852a-98dcdc3af8b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:35.491180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bb1e75da-8342-4f42-852a-98dcdc3af8b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:35.491950 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bb1e75da-8342-4f42-852a-98dcdc3af8b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:35.492391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bb1e75da-8342-4f42-852a-98dcdc3af8b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:35.632065 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-bb1e75da-8342-4f42-852a-98dcdc3af8b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:35.639685 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bb1e75da-8342-4f42-852a-98dcdc3af8b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.160718 Jul 28 18:09:35.640253 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 458/902] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:35 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:35.738826 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-190b7cf3-7aa4-4146-b560-1a6f0bab998f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:35.739437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-190b7cf3-7aa4-4146-b560-1a6f0bab998f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:35.745857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-190b7cf3-7aa4-4146-b560-1a6f0bab998f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:35.746308 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-190b7cf3-7aa4-4146-b560-1a6f0bab998f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:35.747106 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-190b7cf3-7aa4-4146-b560-1a6f0bab998f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:35.747568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-190b7cf3-7aa4-4146-b560-1a6f0bab998f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:35.878916 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-190b7cf3-7aa4-4146-b560-1a6f0bab998f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:35.886499 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-190b7cf3-7aa4-4146-b560-1a6f0bab998f tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.152097 Jul 28 18:09:35.887072 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 445/903] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:35 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:36.659986 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b75cee96-f77e-4c01-a791-b244e94ef335 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:36.660572 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b75cee96-f77e-4c01-a791-b244e94ef335 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:36.667406 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b75cee96-f77e-4c01-a791-b244e94ef335 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:36.667857 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b75cee96-f77e-4c01-a791-b244e94ef335 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:36.668619 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b75cee96-f77e-4c01-a791-b244e94ef335 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:36.669055 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b75cee96-f77e-4c01-a791-b244e94ef335 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:36.892048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b75cee96-f77e-4c01-a791-b244e94ef335 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:36.899824 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b75cee96-f77e-4c01-a791-b244e94ef335 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.243763 Jul 28 18:09:36.900556 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 459/904] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:36 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:36.908772 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-073362ff-b2c6-4a80-8fb8-bec7c05404ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:36.909500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-073362ff-b2c6-4a80-8fb8-bec7c05404ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:36.916406 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-073362ff-b2c6-4a80-8fb8-bec7c05404ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:36.916788 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-073362ff-b2c6-4a80-8fb8-bec7c05404ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:36.917558 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-073362ff-b2c6-4a80-8fb8-bec7c05404ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:36.917993 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-073362ff-b2c6-4a80-8fb8-bec7c05404ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:37.052417 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-073362ff-b2c6-4a80-8fb8-bec7c05404ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:37.060299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-073362ff-b2c6-4a80-8fb8-bec7c05404ab tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.155996 Jul 28 18:09:37.060871 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 446/905] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:36 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:37.722404 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-6b561de5-3cf9-4e1f-83a8-f3ea00f56e4c req-e5d94ca3-9819-4c12-8202-5886ac615e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee5c512-be6b-4ace-a719-1111bf9781be", "name": "network-vif-plugged", "status": "completed", "tag": "865b74cb-5e80-4ef5-a157-9e8ba6c62279"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:37.732746 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-6b561de5-3cf9-4e1f-83a8-f3ea00f56e4c req-e5d94ca3-9819-4c12-8202-5886ac615e22 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:37.733188 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-6b561de5-3cf9-4e1f-83a8-f3ea00f56e4c req-e5d94ca3-9819-4c12-8202-5886ac615e22 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:37.745175 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-6b561de5-3cf9-4e1f-83a8-f3ea00f56e4c req-e5d94ca3-9819-4c12-8202-5886ac615e22 service nova] Creating event network-vif-plugged:865b74cb-5e80-4ef5-a157-9e8ba6c62279 for instance 3ee5c512-be6b-4ace-a719-1111bf9781be on hv-cinder-83754 Jul 28 18:09:37.750386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-6b561de5-3cf9-4e1f-83a8-f3ea00f56e4c req-e5d94ca3-9819-4c12-8202-5886ac615e22 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032511 Jul 28 18:09:37.751115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 460/906] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:09:37.921055 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e9e6a772-f94f-4894-886f-524184385d72 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:37.921658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e9e6a772-f94f-4894-886f-524184385d72 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:37.928568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e9e6a772-f94f-4894-886f-524184385d72 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:37.929005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e9e6a772-f94f-4894-886f-524184385d72 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:37.929768 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e9e6a772-f94f-4894-886f-524184385d72 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:37.930195 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e9e6a772-f94f-4894-886f-524184385d72 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:38.065979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e9e6a772-f94f-4894-886f-524184385d72 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:38.073382 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e9e6a772-f94f-4894-886f-524184385d72 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.156245 Jul 28 18:09:38.073937 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 447/907] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:37 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:38.083250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3cccf6a9-35f3-4b9c-ad51-5a009e4a31e1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:38.083947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3cccf6a9-35f3-4b9c-ad51-5a009e4a31e1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:38.090116 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3cccf6a9-35f3-4b9c-ad51-5a009e4a31e1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:38.090607 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3cccf6a9-35f3-4b9c-ad51-5a009e4a31e1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:38.091374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3cccf6a9-35f3-4b9c-ad51-5a009e4a31e1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:38.091814 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3cccf6a9-35f3-4b9c-ad51-5a009e4a31e1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:38.225340 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3cccf6a9-35f3-4b9c-ad51-5a009e4a31e1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:38.233145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3cccf6a9-35f3-4b9c-ad51-5a009e4a31e1 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.154658 Jul 28 18:09:38.233696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 461/908] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:38 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:39.095354 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9ace0d67-b53e-4c69-80dc-236e3a3a606a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:39.095918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9ace0d67-b53e-4c69-80dc-236e3a3a606a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:39.102894 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9ace0d67-b53e-4c69-80dc-236e3a3a606a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:39.103475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9ace0d67-b53e-4c69-80dc-236e3a3a606a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:39.104393 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9ace0d67-b53e-4c69-80dc-236e3a3a606a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:39.104835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9ace0d67-b53e-4c69-80dc-236e3a3a606a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:39.239103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9ace0d67-b53e-4c69-80dc-236e3a3a606a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:39.246704 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9ace0d67-b53e-4c69-80dc-236e3a3a606a tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1266 microversion: 2.1 time: 0.155894 Jul 28 18:09:39.247344 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 448/909] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:39 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:39.254316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff14fce0-6ad2-435d-8e54-339e7f56bf51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:39.254943 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ff14fce0-6ad2-435d-8e54-339e7f56bf51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:39.261277 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff14fce0-6ad2-435d-8e54-339e7f56bf51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:39.261715 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff14fce0-6ad2-435d-8e54-339e7f56bf51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:39.262505 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff14fce0-6ad2-435d-8e54-339e7f56bf51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:39.262933 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff14fce0-6ad2-435d-8e54-339e7f56bf51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:39.396594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ff14fce0-6ad2-435d-8e54-339e7f56bf51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:39.404078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ff14fce0-6ad2-435d-8e54-339e7f56bf51 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.153761 Jul 28 18:09:39.404641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 462/910] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:39 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:40.267844 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-60914f7c-ec1e-4947-be21-1c01bfb82060 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:40.268479 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-60914f7c-ec1e-4947-be21-1c01bfb82060 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:40.275199 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60914f7c-ec1e-4947-be21-1c01bfb82060 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.280341 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60914f7c-ec1e-4947-be21-1c01bfb82060 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.280341 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60914f7c-ec1e-4947-be21-1c01bfb82060 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.280341 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-60914f7c-ec1e-4947-be21-1c01bfb82060 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.369252 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e458985a-f964-48ef-a997-a60dedca78a6 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:40.369816 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e458985a-f964-48ef-a997-a60dedca78a6 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:40.377894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e458985a-f964-48ef-a997-a60dedca78a6 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.378365 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e458985a-f964-48ef-a997-a60dedca78a6 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.379189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e458985a-f964-48ef-a997-a60dedca78a6 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.379655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e458985a-f964-48ef-a997-a60dedca78a6 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.403656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e458985a-f964-48ef-a997-a60dedca78a6 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/ips" status: 200 len: 144 microversion: 2.1 time: 0.038150 Jul 28 18:09:40.404231 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 463/911] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:09:40 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:09:40.413803 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-60914f7c-ec1e-4947-be21-1c01bfb82060 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:40.421505 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-60914f7c-ec1e-4947-be21-1c01bfb82060 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1452 microversion: 2.1 time: 0.157393 Jul 28 18:09:40.422214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 449/912] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:40 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:40.427028 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2de037d2-e954-4018-938e-f1ad6b5d32de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:40.427635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2de037d2-e954-4018-938e-f1ad6b5d32de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:40.433550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2de037d2-e954-4018-938e-f1ad6b5d32de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.433998 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2de037d2-e954-4018-938e-f1ad6b5d32de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.434886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2de037d2-e954-4018-938e-f1ad6b5d32de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.435320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2de037d2-e954-4018-938e-f1ad6b5d32de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.442547 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f7c28c53-90b0-4ab4-82ed-5e5dc269bffa tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:40.443153 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f7c28c53-90b0-4ab4-82ed-5e5dc269bffa tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:40.449016 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f7c28c53-90b0-4ab4-82ed-5e5dc269bffa tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.449464 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f7c28c53-90b0-4ab4-82ed-5e5dc269bffa tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.450221 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f7c28c53-90b0-4ab4-82ed-5e5dc269bffa tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.450683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f7c28c53-90b0-4ab4-82ed-5e5dc269bffa tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.570817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2de037d2-e954-4018-938e-f1ad6b5d32de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:40.578620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2de037d2-e954-4018-938e-f1ad6b5d32de tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1567 microversion: 2.1 time: 0.155861 Jul 28 18:09:40.580078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 464/913] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:40 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:40.584409 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f7c28c53-90b0-4ab4-82ed-5e5dc269bffa tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:40.592001 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f7c28c53-90b0-4ab4-82ed-5e5dc269bffa tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1452 microversion: 2.1 time: 0.154043 Jul 28 18:09:40.592559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 450/914] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:40 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:40.600146 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-220e7ceb-5878-480f-8f26-8a3391700c78 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:40.600742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-220e7ceb-5878-480f-8f26-8a3391700c78 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:40.607177 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-220e7ceb-5878-480f-8f26-8a3391700c78 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.607555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-220e7ceb-5878-480f-8f26-8a3391700c78 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.608524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-220e7ceb-5878-480f-8f26-8a3391700c78 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:40.608824 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-220e7ceb-5878-480f-8f26-8a3391700c78 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:40.789075 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-220e7ceb-5878-480f-8f26-8a3391700c78 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130400) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 18:09:41.167031 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-220e7ceb-5878-480f-8f26-8a3391700c78 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "POST /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796/action" status: 202 len: 0 microversion: 2.1 time: 0.570728 Jul 28 18:09:41.167645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 465/915] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:09:40 2022] POST /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:09:41.175953 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-95328777-605e-4f95-a9a1-34275a2cd8f8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:41.176558 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-95328777-605e-4f95-a9a1-34275a2cd8f8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:41.182442 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95328777-605e-4f95-a9a1-34275a2cd8f8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:41.182878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95328777-605e-4f95-a9a1-34275a2cd8f8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:41.183635 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95328777-605e-4f95-a9a1-34275a2cd8f8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:41.184100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95328777-605e-4f95-a9a1-34275a2cd8f8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:41.328557 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-95328777-605e-4f95-a9a1-34275a2cd8f8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:41.337698 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-95328777-605e-4f95-a9a1-34275a2cd8f8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1575 microversion: 2.1 time: 0.165575 Jul 28 18:09:41.340408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 451/916] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:41 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:42.360104 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-59c21694-b9a2-4c56-aed9-14c5c7620d9a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:42.360817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-59c21694-b9a2-4c56-aed9-14c5c7620d9a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:42.367232 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-59c21694-b9a2-4c56-aed9-14c5c7620d9a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:42.367984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-59c21694-b9a2-4c56-aed9-14c5c7620d9a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:42.368836 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-59c21694-b9a2-4c56-aed9-14c5c7620d9a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:42.369388 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-59c21694-b9a2-4c56-aed9-14c5c7620d9a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:42.616868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-59c21694-b9a2-4c56-aed9-14c5c7620d9a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:42.625449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-59c21694-b9a2-4c56-aed9-14c5c7620d9a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1515 microversion: 2.1 time: 0.269582 Jul 28 18:09:42.627146 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 466/917] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:42 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1515 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:43.158457 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-b5700ed6-88cb-4aa1-95a6-34517d0099e7 req-0d68ed46-ce9a-4a42-847b-9a979bb5ee21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee5c512-be6b-4ace-a719-1111bf9781be", "tag": "865b74cb-5e80-4ef5-a157-9e8ba6c62279"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:43.169003 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-b5700ed6-88cb-4aa1-95a6-34517d0099e7 req-0d68ed46-ce9a-4a42-847b-9a979bb5ee21 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:43.169451 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-b5700ed6-88cb-4aa1-95a6-34517d0099e7 req-0d68ed46-ce9a-4a42-847b-9a979bb5ee21 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:43.174174 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=100 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:43.183205 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-b5700ed6-88cb-4aa1-95a6-34517d0099e7 req-0d68ed46-ce9a-4a42-847b-9a979bb5ee21 service nova] Creating event network-changed:865b74cb-5e80-4ef5-a157-9e8ba6c62279 for instance 3ee5c512-be6b-4ace-a719-1111bf9781be on hv-cinder-83754 Jul 28 18:09:43.186928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-b5700ed6-88cb-4aa1-95a6-34517d0099e7 req-0d68ed46-ce9a-4a42-847b-9a979bb5ee21 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032295 Jul 28 18:09:43.187692 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 452/918] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:09:43.651429 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-665df528-94da-489e-ad90-ed9c1fe6560c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:43.652047 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-665df528-94da-489e-ad90-ed9c1fe6560c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:43.660038 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-665df528-94da-489e-ad90-ed9c1fe6560c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:43.660756 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-665df528-94da-489e-ad90-ed9c1fe6560c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:43.661543 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-665df528-94da-489e-ad90-ed9c1fe6560c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:43.662154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-665df528-94da-489e-ad90-ed9c1fe6560c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:43.754759 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-a3cde891-38d9-4b1e-859d-ef42815017c6 req-e5aa1b88-6ac7-43ea-af43-e87bb240639c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e56a37-546f-4aa0-a30d-7e0108b17796", "name": "network-vif-unplugged", "status": "completed", "tag": "d86bf1f7-161e-40c1-a007-0a9f75542440"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:43.775627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-a3cde891-38d9-4b1e-859d-ef42815017c6 req-e5aa1b88-6ac7-43ea-af43-e87bb240639c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:43.776080 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-a3cde891-38d9-4b1e-859d-ef42815017c6 req-e5aa1b88-6ac7-43ea-af43-e87bb240639c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:43.791658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.compute.server_external_events [req-a3cde891-38d9-4b1e-859d-ef42815017c6 req-e5aa1b88-6ac7-43ea-af43-e87bb240639c service nova] Unable to find a host for instance 08e56a37-546f-4aa0-a30d-7e0108b17796. Dropping event network-vif-unplugged {{(pid=130401) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 18:09:43.792719 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-a3cde891-38d9-4b1e-859d-ef42815017c6 req-e5aa1b88-6ac7-43ea-af43-e87bb240639c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046588 Jul 28 18:09:43.793785 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 453/919] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 18:09:43.859612 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-665df528-94da-489e-ad90-ed9c1fe6560c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:43.869688 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-665df528-94da-489e-ad90-ed9c1fe6560c tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1517 microversion: 2.1 time: 0.222272 Jul 28 18:09:43.876399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 467/920] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:43 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:43.930127 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-79c89fde-d744-4568-b9e4-7830331b9ae1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "811c9216-7b65-4cab-9d60-93e38dbaa62c"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:43.933021 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-79c89fde-d744-4568-b9e4-7830331b9ae1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:43.941292 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-79c89fde-d744-4568-b9e4-7830331b9ae1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:43.941871 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-79c89fde-d744-4568-b9e4-7830331b9ae1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:43.942740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-79c89fde-d744-4568-b9e4-7830331b9ae1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:43.943248 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-79c89fde-d744-4568-b9e4-7830331b9ae1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:44.892347 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0c1909b1-09f7-4c8b-a5e2-266d52c85fb4 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:44.893111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0c1909b1-09f7-4c8b-a5e2-266d52c85fb4 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:44.900079 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0c1909b1-09f7-4c8b-a5e2-266d52c85fb4 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:44.900526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0c1909b1-09f7-4c8b-a5e2-266d52c85fb4 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:44.901300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0c1909b1-09f7-4c8b-a5e2-266d52c85fb4 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:44.901728 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0c1909b1-09f7-4c8b-a5e2-266d52c85fb4 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:44.906111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:09:44.940113 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-79c89fde-d744-4568-b9e4-7830331b9ae1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.014139 Jul 28 18:09:44.946154 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 454/921] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:09:43 2022] POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/os-volume_attachments => generated 194 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:09:45.135548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0c1909b1-09f7-4c8b-a5e2-266d52c85fb4 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:45.142747 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0c1909b1-09f7-4c8b-a5e2-266d52c85fb4 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.254933 Jul 28 18:09:45.143313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 468/922] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:44 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:46.164543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-829dcd5c-daf7-4e11-a9a7-9e2620809ceb tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:46.165163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-829dcd5c-daf7-4e11-a9a7-9e2620809ceb tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:46.172258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-829dcd5c-daf7-4e11-a9a7-9e2620809ceb tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:46.172727 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-829dcd5c-daf7-4e11-a9a7-9e2620809ceb tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:46.173495 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-829dcd5c-daf7-4e11-a9a7-9e2620809ceb tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:46.173935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-829dcd5c-daf7-4e11-a9a7-9e2620809ceb tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:46.306596 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-829dcd5c-daf7-4e11-a9a7-9e2620809ceb tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:46.314115 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-829dcd5c-daf7-4e11-a9a7-9e2620809ceb tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.153857 Jul 28 18:09:46.314702 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 455/923] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:46 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:47.336107 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0264a028-def4-4fe1-ac23-182e639dac06 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:47.336722 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0264a028-def4-4fe1-ac23-182e639dac06 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:47.343696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0264a028-def4-4fe1-ac23-182e639dac06 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:47.344169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0264a028-def4-4fe1-ac23-182e639dac06 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:47.344936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0264a028-def4-4fe1-ac23-182e639dac06 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:47.345364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0264a028-def4-4fe1-ac23-182e639dac06 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:47.478144 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0264a028-def4-4fe1-ac23-182e639dac06 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:47.486081 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0264a028-def4-4fe1-ac23-182e639dac06 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.153938 Jul 28 18:09:47.486674 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 469/924] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:47 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:48.507269 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0250b9b2-9ac6-4d20-ac39-0f3cd944386e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:48.507899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0250b9b2-9ac6-4d20-ac39-0f3cd944386e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:48.514466 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0250b9b2-9ac6-4d20-ac39-0f3cd944386e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:48.514912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0250b9b2-9ac6-4d20-ac39-0f3cd944386e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:48.515680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0250b9b2-9ac6-4d20-ac39-0f3cd944386e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:48.516608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0250b9b2-9ac6-4d20-ac39-0f3cd944386e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:48.657150 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0250b9b2-9ac6-4d20-ac39-0f3cd944386e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:48.665057 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0250b9b2-9ac6-4d20-ac39-0f3cd944386e tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.161658 Jul 28 18:09:48.668000 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 456/925] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:48 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:49.686736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3e7428e1-b98a-493c-92d8-7ed06cbd4764 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:49.687344 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3e7428e1-b98a-493c-92d8-7ed06cbd4764 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:49.694069 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3e7428e1-b98a-493c-92d8-7ed06cbd4764 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:49.694549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3e7428e1-b98a-493c-92d8-7ed06cbd4764 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:49.695311 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3e7428e1-b98a-493c-92d8-7ed06cbd4764 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:49.695746 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3e7428e1-b98a-493c-92d8-7ed06cbd4764 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:49.834173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3e7428e1-b98a-493c-92d8-7ed06cbd4764 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:49.841919 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3e7428e1-b98a-493c-92d8-7ed06cbd4764 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.158994 Jul 28 18:09:49.842499 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 470/926] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:49 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:50.863964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cfcf7e78-705d-4ac5-8b28-a2bbca598e31 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:50.864600 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cfcf7e78-705d-4ac5-8b28-a2bbca598e31 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:50.871043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cfcf7e78-705d-4ac5-8b28-a2bbca598e31 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:50.871484 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cfcf7e78-705d-4ac5-8b28-a2bbca598e31 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:50.872233 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cfcf7e78-705d-4ac5-8b28-a2bbca598e31 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:50.872659 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cfcf7e78-705d-4ac5-8b28-a2bbca598e31 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:51.004103 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-cfcf7e78-705d-4ac5-8b28-a2bbca598e31 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:51.011758 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cfcf7e78-705d-4ac5-8b28-a2bbca598e31 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.151641 Jul 28 18:09:51.012322 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 457/927] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:50 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:52.033061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-856da745-8f2f-4ea5-82ac-53c24fa3e033 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:52.033664 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-856da745-8f2f-4ea5-82ac-53c24fa3e033 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:52.040148 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-856da745-8f2f-4ea5-82ac-53c24fa3e033 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:52.040590 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-856da745-8f2f-4ea5-82ac-53c24fa3e033 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:52.041347 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-856da745-8f2f-4ea5-82ac-53c24fa3e033 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:52.041779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-856da745-8f2f-4ea5-82ac-53c24fa3e033 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:52.175297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-856da745-8f2f-4ea5-82ac-53c24fa3e033 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:52.184097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-856da745-8f2f-4ea5-82ac-53c24fa3e033 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.154902 Jul 28 18:09:52.184864 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 471/928] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:52 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:53.205619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-eca711c3-f9ad-4875-bfdf-6575e7be977d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:53.206232 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-eca711c3-f9ad-4875-bfdf-6575e7be977d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:53.212899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eca711c3-f9ad-4875-bfdf-6575e7be977d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:53.213345 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eca711c3-f9ad-4875-bfdf-6575e7be977d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:53.214102 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eca711c3-f9ad-4875-bfdf-6575e7be977d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:53.214570 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-eca711c3-f9ad-4875-bfdf-6575e7be977d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:53.344094 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-eca711c3-f9ad-4875-bfdf-6575e7be977d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:53.351554 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-eca711c3-f9ad-4875-bfdf-6575e7be977d tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.150357 Jul 28 18:09:53.352122 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 458/929] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:53 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:53.534785 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ce3ebdc3-7115-4289-99c5-b2046e10cc9d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:53.541320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce3ebdc3-7115-4289-99c5-b2046e10cc9d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:53.541774 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce3ebdc3-7115-4289-99c5-b2046e10cc9d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:53.601482 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ce3ebdc3-7115-4289-99c5-b2046e10cc9d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Going to try to stop instance {{(pid=130400) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 18:09:53.784014 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ce3ebdc3-7115-4289-99c5-b2046e10cc9d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/action" status: 202 len: 0 microversion: 2.1 time: 0.252949 Jul 28 18:09:53.784657 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 472/930] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:09:53 2022] POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:09:53.793030 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e4fa2265-3dcc-4e84-bceb-794e6c95f729 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:53.793644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e4fa2265-3dcc-4e84-bceb-794e6c95f729 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:53.800418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4fa2265-3dcc-4e84-bceb-794e6c95f729 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:53.800873 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4fa2265-3dcc-4e84-bceb-794e6c95f729 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:53.801651 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4fa2265-3dcc-4e84-bceb-794e6c95f729 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:53.802092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e4fa2265-3dcc-4e84-bceb-794e6c95f729 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:53.935770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e4fa2265-3dcc-4e84-bceb-794e6c95f729 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:53.944509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e4fa2265-3dcc-4e84-bceb-794e6c95f729 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.155458 Jul 28 18:09:53.945082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 459/931] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:53 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:54.373654 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7b243cea-75c9-4cf5-b1a6-e8dbc6abb2d3 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:54.374270 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7b243cea-75c9-4cf5-b1a6-e8dbc6abb2d3 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:54.380713 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7b243cea-75c9-4cf5-b1a6-e8dbc6abb2d3 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:54.381155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7b243cea-75c9-4cf5-b1a6-e8dbc6abb2d3 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:54.381917 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7b243cea-75c9-4cf5-b1a6-e8dbc6abb2d3 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:54.382363 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7b243cea-75c9-4cf5-b1a6-e8dbc6abb2d3 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:54.520861 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7b243cea-75c9-4cf5-b1a6-e8dbc6abb2d3 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:54.528448 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7b243cea-75c9-4cf5-b1a6-e8dbc6abb2d3 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.159038 Jul 28 18:09:54.529001 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 473/932] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:54 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:54.966377 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-97f0bd7b-b5fa-4ee6-8c0f-dd578218b087 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:54.967037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-97f0bd7b-b5fa-4ee6-8c0f-dd578218b087 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:54.973727 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-97f0bd7b-b5fa-4ee6-8c0f-dd578218b087 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:54.974183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-97f0bd7b-b5fa-4ee6-8c0f-dd578218b087 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:54.974999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-97f0bd7b-b5fa-4ee6-8c0f-dd578218b087 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:54.975447 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-97f0bd7b-b5fa-4ee6-8c0f-dd578218b087 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:55.111780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-97f0bd7b-b5fa-4ee6-8c0f-dd578218b087 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:55.121548 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-97f0bd7b-b5fa-4ee6-8c0f-dd578218b087 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.159117 Jul 28 18:09:55.122115 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 460/933] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:54 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:55.543165 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0ba02e4c-5e26-4b51-9abb-9afc53990793 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:55.545411 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0ba02e4c-5e26-4b51-9abb-9afc53990793 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:55.549708 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-de9299d2-7b77-4c58-9483-2bd73ae8c5fc tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:55.550317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-de9299d2-7b77-4c58-9483-2bd73ae8c5fc tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:55.553097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ba02e4c-5e26-4b51-9abb-9afc53990793 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:55.553540 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ba02e4c-5e26-4b51-9abb-9afc53990793 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:55.554332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ba02e4c-5e26-4b51-9abb-9afc53990793 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:55.554758 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ba02e4c-5e26-4b51-9abb-9afc53990793 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:55.556356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-de9299d2-7b77-4c58-9483-2bd73ae8c5fc tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:55.556807 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-de9299d2-7b77-4c58-9483-2bd73ae8c5fc tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:55.557573 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-de9299d2-7b77-4c58-9483-2bd73ae8c5fc tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:55.558005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-de9299d2-7b77-4c58-9483-2bd73ae8c5fc tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:55.583994 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0ba02e4c-5e26-4b51-9abb-9afc53990793 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044702 Jul 28 18:09:55.584558 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 474/934] 10.222.0.85 () {60 vars in 1343 bytes} [Thu Jul 28 18:09:55 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:55.652054 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0179617c-bf74-4f46-b779-ab8ef14d96b5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:55.652825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0179617c-bf74-4f46-b779-ab8ef14d96b5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:55.660186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0179617c-bf74-4f46-b779-ab8ef14d96b5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:55.660877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0179617c-bf74-4f46-b779-ab8ef14d96b5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:55.661809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0179617c-bf74-4f46-b779-ab8ef14d96b5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:55.662426 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0179617c-bf74-4f46-b779-ab8ef14d96b5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:55.692323 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0179617c-bf74-4f46-b779-ab8ef14d96b5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Going to try to terminate instance {{(pid=130400) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:09:55.703335 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-de9299d2-7b77-4c58-9483-2bd73ae8c5fc tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:55.712168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-de9299d2-7b77-4c58-9483-2bd73ae8c5fc tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.167076 Jul 28 18:09:55.713019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 461/935] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:55 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:55.787911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-04b4215c-8043-4b02-a0c7-5b14c07e4778 req-3aac3279-5788-4090-89e4-8570d87ac65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e56a37-546f-4aa0-a30d-7e0108b17796", "name": "network-vif-plugged", "status": "completed", "tag": "d86bf1f7-161e-40c1-a007-0a9f75542440"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:55.798381 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-04b4215c-8043-4b02-a0c7-5b14c07e4778 req-3aac3279-5788-4090-89e4-8570d87ac65a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:55.798965 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-04b4215c-8043-4b02-a0c7-5b14c07e4778 req-3aac3279-5788-4090-89e4-8570d87ac65a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:55.809836 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-04b4215c-8043-4b02-a0c7-5b14c07e4778 req-3aac3279-5788-4090-89e4-8570d87ac65a service nova] Creating event network-vif-plugged:d86bf1f7-161e-40c1-a007-0a9f75542440 for instance 08e56a37-546f-4aa0-a30d-7e0108b17796 on hv-cinder-83754 Jul 28 18:09:55.816935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-04b4215c-8043-4b02-a0c7-5b14c07e4778 req-3aac3279-5788-4090-89e4-8570d87ac65a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030688 Jul 28 18:09:55.816935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 462/936] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:09:56.066912 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0179617c-bf74-4f46-b779-ab8ef14d96b5 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 204 len: 0 microversion: 2.20 time: 0.418253 Jul 28 18:09:56.068030 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 475/937] 10.222.0.85 () {60 vars in 1280 bytes} [Thu Jul 28 18:09:55 2022] DELETE /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 18:09:56.077552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:56.083598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:56.085157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:56.085619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:56.086445 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:56.086899 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:56.144207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6c4cebbe-af94-4a79-a164-8a0e395774d9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:56.145021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6c4cebbe-af94-4a79-a164-8a0e395774d9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:56.151246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6c4cebbe-af94-4a79-a164-8a0e395774d9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:56.151792 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6c4cebbe-af94-4a79-a164-8a0e395774d9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:56.152634 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6c4cebbe-af94-4a79-a164-8a0e395774d9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:56.153073 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6c4cebbe-af94-4a79-a164-8a0e395774d9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:56.220636 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:56.228913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:56.230478 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:56.231669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-83a84710-60d4-4485-aaaa-ba468113b27a tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.159063 Jul 28 18:09:56.232231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 463/938] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:56 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:56.291552 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6c4cebbe-af94-4a79-a164-8a0e395774d9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:56.299696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6c4cebbe-af94-4a79-a164-8a0e395774d9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.160295 Jul 28 18:09:56.300254 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 476/939] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:56 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:56.733450 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a6e57f79-9e3d-421d-92bd-16acc1008fb5 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:56.734056 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a6e57f79-9e3d-421d-92bd-16acc1008fb5 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:56.741021 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a6e57f79-9e3d-421d-92bd-16acc1008fb5 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:56.741464 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a6e57f79-9e3d-421d-92bd-16acc1008fb5 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:56.742210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a6e57f79-9e3d-421d-92bd-16acc1008fb5 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:56.742704 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a6e57f79-9e3d-421d-92bd-16acc1008fb5 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:56.875288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a6e57f79-9e3d-421d-92bd-16acc1008fb5 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:56.884516 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a6e57f79-9e3d-421d-92bd-16acc1008fb5 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.154238 Jul 28 18:09:56.884516 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 464/940] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:56 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:57.254775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:57.260487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:57.261943 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:57.262427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:57.263196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:57.263629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:57.321742 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bc3b0ca6-1014-4730-a8f9-12a4c8e73a25 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:57.322589 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bc3b0ca6-1014-4730-a8f9-12a4c8e73a25 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:57.329502 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc3b0ca6-1014-4730-a8f9-12a4c8e73a25 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:57.330757 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc3b0ca6-1014-4730-a8f9-12a4c8e73a25 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:57.332237 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc3b0ca6-1014-4730-a8f9-12a4c8e73a25 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:57.332712 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc3b0ca6-1014-4730-a8f9-12a4c8e73a25 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:57.403855 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:57.413267 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:57.414881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:57.416064 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b694ef7b-a7df-4f44-8a28-3eb463b4c6ec tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.165259 Jul 28 18:09:57.416618 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 477/941] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:57 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:57.473772 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bc3b0ca6-1014-4730-a8f9-12a4c8e73a25 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:57.482216 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bc3b0ca6-1014-4730-a8f9-12a4c8e73a25 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.164617 Jul 28 18:09:57.482824 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 465/942] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:57 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:57.904696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7884ac87-6669-4e62-a5f9-ae5dbc3dd926 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:57.905307 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7884ac87-6669-4e62-a5f9-ae5dbc3dd926 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:57.911905 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7884ac87-6669-4e62-a5f9-ae5dbc3dd926 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:57.912352 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7884ac87-6669-4e62-a5f9-ae5dbc3dd926 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:57.913119 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7884ac87-6669-4e62-a5f9-ae5dbc3dd926 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:57.913551 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7884ac87-6669-4e62-a5f9-ae5dbc3dd926 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:58.089421 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7884ac87-6669-4e62-a5f9-ae5dbc3dd926 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:58.097115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7884ac87-6669-4e62-a5f9-ae5dbc3dd926 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1573 microversion: 2.1 time: 0.196252 Jul 28 18:09:58.097593 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 478/943] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:57 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1573 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:58.440712 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:58.441253 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:58.447997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:58.448214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:58.449018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:58.449457 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:58.503827 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2524feee-a389-462d-9fbb-629e7e3b0775 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:58.504446 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2524feee-a389-462d-9fbb-629e7e3b0775 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:58.511147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2524feee-a389-462d-9fbb-629e7e3b0775 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:58.511594 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2524feee-a389-462d-9fbb-629e7e3b0775 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:58.512450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2524feee-a389-462d-9fbb-629e7e3b0775 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:58.512902 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2524feee-a389-462d-9fbb-629e7e3b0775 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:58.587979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:58.596994 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:58.598592 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:58.599780 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-541b853d-a6d6-4c1b-88de-06cfea7974dd tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1722 microversion: 2.20 time: 0.163497 Jul 28 18:09:58.600447 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 466/944] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:58 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:58.786278 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2524feee-a389-462d-9fbb-629e7e3b0775 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:58.803377 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2524feee-a389-462d-9fbb-629e7e3b0775 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.303568 Jul 28 18:09:58.804403 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 479/945] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:58 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:09:59.119986 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5ae16052-e7e1-45ee-98ee-479c2188ed13 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:59.120928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5ae16052-e7e1-45ee-98ee-479c2188ed13 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:59.128197 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ae16052-e7e1-45ee-98ee-479c2188ed13 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:59.128656 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ae16052-e7e1-45ee-98ee-479c2188ed13 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:59.130338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ae16052-e7e1-45ee-98ee-479c2188ed13 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:59.130338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ae16052-e7e1-45ee-98ee-479c2188ed13 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:59.344484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-a8acc2c9-8f23-4fb4-b7dd-1067e06127fe req-331699a7-bea7-47c7-9cfb-73e7dd571a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ad8548-670a-4120-9652-2c63a78dd575", "name": "network-vif-deleted", "tag": "7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:09:59.356142 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-a8acc2c9-8f23-4fb4-b7dd-1067e06127fe req-331699a7-bea7-47c7-9cfb-73e7dd571a87 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:59.356889 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-a8acc2c9-8f23-4fb4-b7dd-1067e06127fe req-331699a7-bea7-47c7-9cfb-73e7dd571a87 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:59.369286 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-a8acc2c9-8f23-4fb4-b7dd-1067e06127fe req-331699a7-bea7-47c7-9cfb-73e7dd571a87 service nova] Creating event network-vif-deleted:7f7a608d-6cef-4a1a-b4b5-f135fb1f44a1 for instance b6ad8548-670a-4120-9652-2c63a78dd575 on hv-cinder-83754 Jul 28 18:09:59.375234 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-a8acc2c9-8f23-4fb4-b7dd-1067e06127fe req-331699a7-bea7-47c7-9cfb-73e7dd571a87 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034093 Jul 28 18:09:59.380002 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 480/946] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:09:59.546247 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5ae16052-e7e1-45ee-98ee-479c2188ed13 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:59.561394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5ae16052-e7e1-45ee-98ee-479c2188ed13 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1560 microversion: 2.1 time: 0.444786 Jul 28 18:09:59.562652 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 467/947] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:59 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1560 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:09:59.624968 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:59.628533 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:59.636246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:59.636683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:59.637470 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:59.637910 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:59.710399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:59.718792 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:59.720021 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:59.721581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ad941fde-edb0-4862-a5d1-343e0173091b tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1654 microversion: 2.20 time: 0.100928 Jul 28 18:09:59.726524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 481/948] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:09:59 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:09:59.827387 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b15bc3b4-9dca-4b72-bc13-75d0eba8746e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:09:59.827387 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b15bc3b4-9dca-4b72-bc13-75d0eba8746e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:09:59.832633 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b15bc3b4-9dca-4b72-bc13-75d0eba8746e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:59.833205 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b15bc3b4-9dca-4b72-bc13-75d0eba8746e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:59.833997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b15bc3b4-9dca-4b72-bc13-75d0eba8746e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:09:59.834468 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b15bc3b4-9dca-4b72-bc13-75d0eba8746e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:09:59.967110 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b15bc3b4-9dca-4b72-bc13-75d0eba8746e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:09:59.976639 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b15bc3b4-9dca-4b72-bc13-75d0eba8746e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.155633 Jul 28 18:09:59.977212 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 468/949] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:09:59 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:00.745317 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:00.745955 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:00.752707 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:00.753154 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:00.753934 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:00.754387 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:00.789147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:00.789541 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:00.790038 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lazy-loading 'fault' on Instance uuid b6ad8548-670a-4120-9652-2c63a78dd575 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:10:00.793012 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:00.858909 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:00.868813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:00.870361 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f740005b7fc245919a6ddbf61ee9ba85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2732f627abb44936bedd3293898b24f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:00.871522 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-da619e6b-f7bd-4e12-825a-21183819d9a9 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 200 len: 1370 microversion: 2.20 time: 0.130203 Jul 28 18:10:00.872076 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 482/950] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:10:00 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 1370 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 18:10:00.999189 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-61f4fc9f-1b86-4a42-963a-d0da3a1d0f08 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:00.999779 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-61f4fc9f-1b86-4a42-963a-d0da3a1d0f08 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:01.007023 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-61f4fc9f-1b86-4a42-963a-d0da3a1d0f08 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:01.015743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-61f4fc9f-1b86-4a42-963a-d0da3a1d0f08 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:01.015743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-61f4fc9f-1b86-4a42-963a-d0da3a1d0f08 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:01.015743 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-61f4fc9f-1b86-4a42-963a-d0da3a1d0f08 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:01.024612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:01.149503 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-61f4fc9f-1b86-4a42-963a-d0da3a1d0f08 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:01.157449 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-61f4fc9f-1b86-4a42-963a-d0da3a1d0f08 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.162161 Jul 28 18:10:01.158059 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 469/951] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:00 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:10:01.895050 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:01.895662 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:01.902849 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:01.903368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:01.904142 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:01.904579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:01.918911 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] HTTP exception thrown: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Request method failure captured: Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 HTTP/1.1 Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8fsPLj_Z3T0XuJePQXJGOoOuELY6vA1cXtiUfOCGkJL7bBAe--PK6k7qmG_rjCbwE4nRwpIQD51kTzXfqXt3YKzOOmEBYK5tf72APNQrI89raY08kff4nBr6dHtgrqlpBqu-cjTYUKdw_7jh_pGoUtmOmohMJPGbotPhutzsF0ubI Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:10:01.920935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2732f627abb44936bedd3293898b24f3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2732f627abb44936bedd3293898b24f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: f740005b7fc245919a6ddbf61ee9ba85 Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:01.922660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': 'b6ad8548-670a-4120-9652-2c63a78dd575'} Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:10:01.923640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:01.925246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:01.926624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Returning 404 to user: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:10:01.926624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a5f10315-5759-4dd8-be07-d7ee94909b68 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 404 len: 111 microversion: 2.20 time: 0.031476 Jul 28 18:10:01.926624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 483/952] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:10:01 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:10:01.931386 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7d1d3526-5d5d-4fa6-a4a1-840fbc308e1d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '.version_select at 0x7fdae0285c10>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:01.936050 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7d1d3526-5d5d-4fa6-a4a1-840fbc308e1d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [f8db0c00-035f-44c2-b010-b773d83594a0] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:10:02.179241 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b652dc47-baed-4949-b31b-8cd92bb3ad6b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:02.179768 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b652dc47-baed-4949-b31b-8cd92bb3ad6b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:02.181607 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:02.186376 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b652dc47-baed-4949-b31b-8cd92bb3ad6b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:02.186820 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b652dc47-baed-4949-b31b-8cd92bb3ad6b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:02.187636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b652dc47-baed-4949-b31b-8cd92bb3ad6b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:02.188071 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b652dc47-baed-4949-b31b-8cd92bb3ad6b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:02.322261 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b652dc47-baed-4949-b31b-8cd92bb3ad6b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:02.330830 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b652dc47-baed-4949-b31b-8cd92bb3ad6b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.155832 Jul 28 18:10:02.331432 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 484/953] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:02 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:10:02.943832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [None req-7d1d3526-5d5d-4fa6-a4a1-840fbc308e1d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [f8db0c00-035f-44c2-b010-b773d83594a0] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 42526. Jul 28 18:10:02.951096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=56 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:03.015695 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7d1d3526-5d5d-4fa6-a4a1-840fbc308e1d tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982793069" status: 204 len: 0 microversion: 2.20 time: 1.088319 Jul 28 18:10:03.016454 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 470/954] 10.222.0.85 () {60 vars in 1262 bytes} [Thu Jul 28 18:10:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1982793069 => generated 0 bytes in 1090 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 18:10:03.353186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c069b2a7-80ea-4571-b24e-86938919a5cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:03.353750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c069b2a7-80ea-4571-b24e-86938919a5cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:03.360280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c069b2a7-80ea-4571-b24e-86938919a5cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:03.360738 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c069b2a7-80ea-4571-b24e-86938919a5cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:03.362195 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c069b2a7-80ea-4571-b24e-86938919a5cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:03.362936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c069b2a7-80ea-4571-b24e-86938919a5cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:03.507028 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c069b2a7-80ea-4571-b24e-86938919a5cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:03.516241 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c069b2a7-80ea-4571-b24e-86938919a5cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.166924 Jul 28 18:10:03.517636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 485/955] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:03 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:04.539000 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d1ee9e55-c56d-4d1c-be12-fc6ddb887b3f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:04.539636 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d1ee9e55-c56d-4d1c-be12-fc6ddb887b3f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:04.546380 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1ee9e55-c56d-4d1c-be12-fc6ddb887b3f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:04.546826 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1ee9e55-c56d-4d1c-be12-fc6ddb887b3f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:04.547591 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1ee9e55-c56d-4d1c-be12-fc6ddb887b3f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:04.548020 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d1ee9e55-c56d-4d1c-be12-fc6ddb887b3f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:04.679087 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d1ee9e55-c56d-4d1c-be12-fc6ddb887b3f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:04.687190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d1ee9e55-c56d-4d1c-be12-fc6ddb887b3f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.153150 Jul 28 18:10:04.687747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 471/956] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:04 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:05.103519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:05.104017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:05.110249 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:05.111271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:05.112098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:05.112535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:05.125908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] HTTP exception thrown: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Request method failure captured: Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: DELETE /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 HTTP/1.1 Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8fsPLj_Z3T0XuJePQXJGOoOuELY6vA1cXtiUfOCGkJL7bBAe--PK6k7qmG_rjCbwE4nRwpIQD51kTzXfqXt3YKzOOmEBYK5tf72APNQrI89raY08kff4nBr6dHtgrqlpBqu-cjTYUKdw_7jh_pGoUtmOmohMJPGbotPhutzsF0ubI Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:10:05.128147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2732f627abb44936bedd3293898b24f3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2732f627abb44936bedd3293898b24f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: f740005b7fc245919a6ddbf61ee9ba85 Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.129773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': 'b6ad8548-670a-4120-9652-2c63a78dd575'} Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:10:05.130679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.132127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.133535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Returning 404 to user: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:10:05.133535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e3402463-20cc-43a4-9a21-18d94aff25c8 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 404 len: 111 microversion: 2.20 time: 0.030362 Jul 28 18:10:05.133535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 486/957] 10.222.0.85 () {60 vars in 1280 bytes} [Thu Jul 28 18:10:05 2022] DELETE /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:10:05.138369 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:05.138989 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: b6ad8548-670a-4120-9652-2c63a78dd575] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:05.145122 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:05.145578 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:05.146371 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:05.146811 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:05.160880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] HTTP exception thrown: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Request method failure captured: Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 HTTP/1.1 Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8fsPLj_Z3T0XuJePQXJGOoOuELY6vA1cXtiUfOCGkJL7bBAe--PK6k7qmG_rjCbwE4nRwpIQD51kTzXfqXt3YKzOOmEBYK5tf72APNQrI89raY08kff4nBr6dHtgrqlpBqu-cjTYUKdw_7jh_pGoUtmOmohMJPGbotPhutzsF0ubI Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:10:05.162583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2732f627abb44936bedd3293898b24f3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2732f627abb44936bedd3293898b24f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: f740005b7fc245919a6ddbf61ee9ba85 Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.164217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'b6ad8548-670a-4120-9652-2c63a78dd575'} Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:10:05.165155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. Jul 28 18:10:05.166771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:05.168085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Returning 404 to user: Instance b6ad8548-670a-4120-9652-2c63a78dd575 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:10:05.168085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-03cd41b4-f5b5-4d1d-bdfa-b072b12c7ed3 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575" status: 404 len: 111 microversion: 2.20 time: 0.029671 Jul 28 18:10:05.168085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 472/958] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:10:05 2022] GET /compute/v2.1/servers/b6ad8548-670a-4120-9652-2c63a78dd575 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:10:05.708275 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0374fa87-a075-4b06-9059-0ca7a1ceed88 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:05.708862 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0374fa87-a075-4b06-9059-0ca7a1ceed88 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:05.715085 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0374fa87-a075-4b06-9059-0ca7a1ceed88 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:05.715539 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0374fa87-a075-4b06-9059-0ca7a1ceed88 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:05.716288 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0374fa87-a075-4b06-9059-0ca7a1ceed88 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:05.716721 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0374fa87-a075-4b06-9059-0ca7a1ceed88 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:05.849138 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0374fa87-a075-4b06-9059-0ca7a1ceed88 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:05.857587 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0374fa87-a075-4b06-9059-0ca7a1ceed88 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.153771 Jul 28 18:10:05.858205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 487/959] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:05 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:06.435510 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:06.435996 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:06.443183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:06.443636 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:06.444407 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:06.444842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:06.458047 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] HTTP exception thrown: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Request method failure captured: Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 HTTP/1.1 Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s8fsPLj_Z3T0XuJePQXJGOoOuELY6vA1cXtiUfOCGkJL7bBAe--PK6k7qmG_rjCbwE4nRwpIQD51kTzXfqXt3YKzOOmEBYK5tf72APNQrI89raY08kff4nBr6dHtgrqlpBqu-cjTYUKdw_7jh_pGoUtmOmohMJPGbotPhutzsF0ubI Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:10:06.460282 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2732f627abb44936bedd3293898b24f3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2732f627abb44936bedd3293898b24f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: f740005b7fc245919a6ddbf61ee9ba85 Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.461974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '8f64c566-cf5d-4240-95e2-c5746a5bba89'} Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:10:06.462912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.464430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.465973 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Returning 404 to user: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:10:06.465973 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bc2f7af5-ade5-4b9d-9ed7-8b4f0b12d500 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 404 len: 111 microversion: 2.20 time: 0.030002 Jul 28 18:10:06.465973 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 473/960] 10.222.0.85 () {60 vars in 1280 bytes} [Thu Jul 28 18:10:06 2022] DELETE /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:10:06.470492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:06.471120 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] [instance: 8f64c566-cf5d-4240-95e2-c5746a5bba89] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:06.477846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:06.478292 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:06.479094 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:06.479525 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:06.493098 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] HTTP exception thrown: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Request method failure captured: Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 HTTP/1.1 Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s8fsPLj_Z3T0XuJePQXJGOoOuELY6vA1cXtiUfOCGkJL7bBAe--PK6k7qmG_rjCbwE4nRwpIQD51kTzXfqXt3YKzOOmEBYK5tf72APNQrI89raY08kff4nBr6dHtgrqlpBqu-cjTYUKdw_7jh_pGoUtmOmohMJPGbotPhutzsF0ubI Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:10:06.494663 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2732f627abb44936bedd3293898b24f3", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2732f627abb44936bedd3293898b24f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2732f627abb44936bedd3293898b24f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 2732f627abb44936bedd3293898b24f3 Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537835742 Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: f740005b7fc245919a6ddbf61ee9ba85 Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537835742-project Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.496456 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '8f64c566-cf5d-4240-95e2-c5746a5bba89'} Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:10:06.497300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. Jul 28 18:10:06.498648 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:10:06.499755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] Returning 404 to user: Instance 8f64c566-cf5d-4240-95e2-c5746a5bba89 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:10:06.499755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-832958d7-911d-492a-b435-b6b15fea9769 tempest-AttachVolumeShelveTestJSON-537835742 tempest-AttachVolumeShelveTestJSON-537835742-project] 10.222.0.85 "GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89" status: 404 len: 111 microversion: 2.20 time: 0.029761 Jul 28 18:10:06.499755 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 488/961] 10.222.0.85 () {60 vars in 1277 bytes} [Thu Jul 28 18:10:06 2022] GET /compute/v2.1/servers/8f64c566-cf5d-4240-95e2-c5746a5bba89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:10:06.879649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3794bf26-54e3-4d93-a2c0-8cc38aa5d93e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:06.880587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3794bf26-54e3-4d93-a2c0-8cc38aa5d93e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:06.886595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3794bf26-54e3-4d93-a2c0-8cc38aa5d93e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:06.887127 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3794bf26-54e3-4d93-a2c0-8cc38aa5d93e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:06.887827 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3794bf26-54e3-4d93-a2c0-8cc38aa5d93e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:06.888274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3794bf26-54e3-4d93-a2c0-8cc38aa5d93e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:07.139666 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-3794bf26-54e3-4d93-a2c0-8cc38aa5d93e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:07.148494 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3794bf26-54e3-4d93-a2c0-8cc38aa5d93e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.273211 Jul 28 18:10:07.149076 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 474/962] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:06 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:08.170892 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a729d5ca-0dbb-463c-9c41-36d38cbe4504 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:08.172074 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a729d5ca-0dbb-463c-9c41-36d38cbe4504 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:08.179537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a729d5ca-0dbb-463c-9c41-36d38cbe4504 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:08.179990 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a729d5ca-0dbb-463c-9c41-36d38cbe4504 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:08.180766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a729d5ca-0dbb-463c-9c41-36d38cbe4504 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:08.181205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a729d5ca-0dbb-463c-9c41-36d38cbe4504 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:08.327097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a729d5ca-0dbb-463c-9c41-36d38cbe4504 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:08.336131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a729d5ca-0dbb-463c-9c41-36d38cbe4504 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.169105 Jul 28 18:10:08.336719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 489/963] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:08 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:09.357280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fd0686e8-e4b6-49aa-8605-07c36f6b2d1c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:09.358018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-fd0686e8-e4b6-49aa-8605-07c36f6b2d1c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:09.370258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fd0686e8-e4b6-49aa-8605-07c36f6b2d1c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:09.370852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fd0686e8-e4b6-49aa-8605-07c36f6b2d1c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:09.371745 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fd0686e8-e4b6-49aa-8605-07c36f6b2d1c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:09.372293 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-fd0686e8-e4b6-49aa-8605-07c36f6b2d1c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:09.533157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-fd0686e8-e4b6-49aa-8605-07c36f6b2d1c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:09.539396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fd0686e8-e4b6-49aa-8605-07c36f6b2d1c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.185933 Jul 28 18:10:09.539958 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 475/964] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:09 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:10.561049 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-254e47c8-1fa0-4560-b913-c96f583092ba tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:10.561659 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-254e47c8-1fa0-4560-b913-c96f583092ba tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:10.569163 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-254e47c8-1fa0-4560-b913-c96f583092ba tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:10.569607 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-254e47c8-1fa0-4560-b913-c96f583092ba tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:10.570390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-254e47c8-1fa0-4560-b913-c96f583092ba tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:10.570831 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-254e47c8-1fa0-4560-b913-c96f583092ba tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:10.703283 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-254e47c8-1fa0-4560-b913-c96f583092ba tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:10.711908 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-254e47c8-1fa0-4560-b913-c96f583092ba tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.154702 Jul 28 18:10:10.713043 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 490/965] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:10 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:11.734093 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-20afa7d9-9b8c-4a28-ab9f-be2b8d6cb9c4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:11.734811 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-20afa7d9-9b8c-4a28-ab9f-be2b8d6cb9c4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:11.741817 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-20afa7d9-9b8c-4a28-ab9f-be2b8d6cb9c4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:11.742260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-20afa7d9-9b8c-4a28-ab9f-be2b8d6cb9c4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:11.743079 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-20afa7d9-9b8c-4a28-ab9f-be2b8d6cb9c4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:11.743506 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-20afa7d9-9b8c-4a28-ab9f-be2b8d6cb9c4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:11.889641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-20afa7d9-9b8c-4a28-ab9f-be2b8d6cb9c4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:11.898057 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-20afa7d9-9b8c-4a28-ab9f-be2b8d6cb9c4 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.167754 Jul 28 18:10:11.898757 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 476/966] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:11 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:12.920434 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-75f98bd7-84bc-49a1-8bb3-99fb1d161d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:12.921085 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-75f98bd7-84bc-49a1-8bb3-99fb1d161d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:12.928417 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-75f98bd7-84bc-49a1-8bb3-99fb1d161d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:12.928864 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-75f98bd7-84bc-49a1-8bb3-99fb1d161d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:12.929682 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-75f98bd7-84bc-49a1-8bb3-99fb1d161d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:12.930111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-75f98bd7-84bc-49a1-8bb3-99fb1d161d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:13.073615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-75f98bd7-84bc-49a1-8bb3-99fb1d161d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:13.082164 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-75f98bd7-84bc-49a1-8bb3-99fb1d161d8d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.165891 Jul 28 18:10:13.082769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 491/967] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:12 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:14.104356 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d832c005-0cb7-4ff5-96c1-88b54e20684a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:14.104981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d832c005-0cb7-4ff5-96c1-88b54e20684a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:14.112081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d832c005-0cb7-4ff5-96c1-88b54e20684a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:14.112539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d832c005-0cb7-4ff5-96c1-88b54e20684a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:14.113331 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d832c005-0cb7-4ff5-96c1-88b54e20684a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:14.113764 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d832c005-0cb7-4ff5-96c1-88b54e20684a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:14.392741 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d832c005-0cb7-4ff5-96c1-88b54e20684a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:14.401208 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d832c005-0cb7-4ff5-96c1-88b54e20684a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1722 microversion: 2.1 time: 0.301065 Jul 28 18:10:14.401783 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 477/968] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:14 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1722 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:10:15.425918 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-11db1d09-7524-423d-96ef-956fcb03101e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:15.427430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-11db1d09-7524-423d-96ef-956fcb03101e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:15.437776 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11db1d09-7524-423d-96ef-956fcb03101e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:15.437982 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11db1d09-7524-423d-96ef-956fcb03101e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:15.443449 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11db1d09-7524-423d-96ef-956fcb03101e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:15.444131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11db1d09-7524-423d-96ef-956fcb03101e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:15.597644 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-11db1d09-7524-423d-96ef-956fcb03101e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:15.607529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-11db1d09-7524-423d-96ef-956fcb03101e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1699 microversion: 2.1 time: 0.185140 Jul 28 18:10:15.607529 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 492/969] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:15 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1699 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:15.628189 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7938cb5c-ac79-499a-adcd-abf7d7f40ea0 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:10:15.635499 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7938cb5c-ac79-499a-adcd-abf7d7f40ea0 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:15.635968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7938cb5c-ac79-499a-adcd-abf7d7f40ea0 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:15.699605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7938cb5c-ac79-499a-adcd-abf7d7f40ea0 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Going to try to start instance {{(pid=130401) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 18:10:15.874228 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7938cb5c-ac79-499a-adcd-abf7d7f40ea0 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/action" status: 202 len: 0 microversion: 2.1 time: 0.250321 Jul 28 18:10:15.874865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 478/970] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:10:15 2022] POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:10:15.884146 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3fd537b9-3d46-4afb-a1fb-a719a415c1e8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:15.884570 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3fd537b9-3d46-4afb-a1fb-a719a415c1e8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:15.890666 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3fd537b9-3d46-4afb-a1fb-a719a415c1e8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:15.891117 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3fd537b9-3d46-4afb-a1fb-a719a415c1e8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:15.892091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3fd537b9-3d46-4afb-a1fb-a719a415c1e8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:15.892604 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3fd537b9-3d46-4afb-a1fb-a719a415c1e8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:16.045705 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3fd537b9-3d46-4afb-a1fb-a719a415c1e8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:16.054722 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3fd537b9-3d46-4afb-a1fb-a719a415c1e8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1708 microversion: 2.1 time: 0.175010 Jul 28 18:10:16.055298 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 493/971] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:15 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1708 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:17.078553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7ceb2c8e-5dca-421a-a522-33a6ba1ccaab tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:17.080219 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7ceb2c8e-5dca-421a-a522-33a6ba1ccaab tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:17.106473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7ceb2c8e-5dca-421a-a522-33a6ba1ccaab tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:17.107069 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7ceb2c8e-5dca-421a-a522-33a6ba1ccaab tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:17.107947 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7ceb2c8e-5dca-421a-a522-33a6ba1ccaab tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:17.108385 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7ceb2c8e-5dca-421a-a522-33a6ba1ccaab tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:17.323914 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7ceb2c8e-5dca-421a-a522-33a6ba1ccaab tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:17.333710 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7ceb2c8e-5dca-421a-a522-33a6ba1ccaab tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1708 microversion: 2.1 time: 0.260930 Jul 28 18:10:17.334445 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 479/972] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:17 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1708 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:17.469999 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-72420748-6e5a-4e98-8b82-bd0ee0099fd9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: .version_select at 0x7fdae025ba60>, body: {"keypair": {"name": "tempest-keypair-1312655647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDcqWPmbBzxSebn1CSJCvRTr5QIhyuQT51sVzzy+EQBBSg0B+ReNgJUuj3U/9yrHOwnE2bSnLVqIu2k6HQMbtbH74mIhupEl37ey3Cpshhh17AHXOUq3BXKh9GQCy2LoQ=="}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:10:17.487634 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-72420748-6e5a-4e98-8b82-bd0ee0099fd9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:10:17.493000 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-72420748-6e5a-4e98-8b82-bd0ee0099fd9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for user de20d8b31db44abf91a482d81b898755 and project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'key_pairs'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:10:17.598700 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-72420748-6e5a-4e98-8b82-bd0ee0099fd9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315785 Jul 28 18:10:17.599732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 494/973] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:10:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:10:18.356612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8997f8c8-b44a-4ed8-9df1-b3d90bb04e22 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:18.357233 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8997f8c8-b44a-4ed8-9df1-b3d90bb04e22 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:18.364062 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8997f8c8-b44a-4ed8-9df1-b3d90bb04e22 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:18.364520 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8997f8c8-b44a-4ed8-9df1-b3d90bb04e22 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:18.365323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8997f8c8-b44a-4ed8-9df1-b3d90bb04e22 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:18.365767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8997f8c8-b44a-4ed8-9df1-b3d90bb04e22 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:18.526234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8997f8c8-b44a-4ed8-9df1-b3d90bb04e22 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:18.534542 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8997f8c8-b44a-4ed8-9df1-b3d90bb04e22 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1712 microversion: 2.1 time: 0.182011 Jul 28 18:10:18.535119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 480/974] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:18 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1712 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:19.886780 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1622183951", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a1ed8c2-e3be-47b5-8608-0f5e33222798"}], "security_groups": [{"name": "tempest-securitygroup--7067502"}], "key_name": "tempest-keypair-1312655647", "user_data": "}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:10:20.000138 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] validate_networks() for [('7a1ed8c2-e3be-47b5-8608-0f5e33222798', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:10:20.411813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:10:20.412235 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:10:20.412703 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:10:20.413108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:10:20.413556 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:10:20.423027 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:20.423485 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:20.424285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:20.424719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:20.442700 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:10:20.446942 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for user de20d8b31db44abf91a482d81b898755 and project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:10:20.459770 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:10:20.462151 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:10:20.589304 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d35f15af-86a3-4e0b-9c59-1b67ccc1ca45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.706764 Jul 28 18:10:20.596476 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 495/975] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:10:19 2022] POST /compute/v2.1/servers => generated 399 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:10:20.601433 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b53ff18e-8e44-4d07-b353-cef481329ff8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:20.602312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b53ff18e-8e44-4d07-b353-cef481329ff8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:20.939307 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b53ff18e-8e44-4d07-b353-cef481329ff8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:20.946196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b53ff18e-8e44-4d07-b353-cef481329ff8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1242 microversion: 2.1 time: 0.348570 Jul 28 18:10:20.946792 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 481/976] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:20 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1242 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:21.967514 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-856b8b3c-4c99-40e6-9bf9-cdf477e0ba20 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:21.968118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-856b8b3c-4c99-40e6-9bf9-cdf477e0ba20 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:21.975350 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-856b8b3c-4c99-40e6-9bf9-cdf477e0ba20 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:21.975797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-856b8b3c-4c99-40e6-9bf9-cdf477e0ba20 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:21.976590 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-856b8b3c-4c99-40e6-9bf9-cdf477e0ba20 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:21.977300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-856b8b3c-4c99-40e6-9bf9-cdf477e0ba20 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:22.047301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-856b8b3c-4c99-40e6-9bf9-cdf477e0ba20 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:22.055166 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-856b8b3c-4c99-40e6-9bf9-cdf477e0ba20 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1246 microversion: 2.1 time: 0.092180 Jul 28 18:10:22.055732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 496/977] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:21 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:23.077019 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cd5a602a-870a-43d9-9f60-fda1e15dc257 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:23.077626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cd5a602a-870a-43d9-9f60-fda1e15dc257 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:23.085306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd5a602a-870a-43d9-9f60-fda1e15dc257 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:23.095297 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd5a602a-870a-43d9-9f60-fda1e15dc257 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:23.095297 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd5a602a-870a-43d9-9f60-fda1e15dc257 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:23.095297 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cd5a602a-870a-43d9-9f60-fda1e15dc257 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:23.151948 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-cd5a602a-870a-43d9-9f60-fda1e15dc257 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:23.160260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cd5a602a-870a-43d9-9f60-fda1e15dc257 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1294 microversion: 2.1 time: 0.087960 Jul 28 18:10:23.160830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 482/978] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:23 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:24.181357 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9161da05-a70e-41f6-8773-041df6a73e3a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:24.181956 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9161da05-a70e-41f6-8773-041df6a73e3a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:24.190314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9161da05-a70e-41f6-8773-041df6a73e3a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:24.190818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9161da05-a70e-41f6-8773-041df6a73e3a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:24.191611 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9161da05-a70e-41f6-8773-041df6a73e3a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:24.192049 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9161da05-a70e-41f6-8773-041df6a73e3a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:24.388304 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9161da05-a70e-41f6-8773-041df6a73e3a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:24.398204 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9161da05-a70e-41f6-8773-041df6a73e3a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.220350 Jul 28 18:10:24.399121 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 497/979] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:24 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:25.100683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-f03694cc-d46e-4dcc-ac00-37f70887f4ba req-d0bdc8de-8689-4443-88d8-c05939bd58ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9e762e-5473-4949-8d19-ff0bfe5bb52b", "tag": "af478c0c-b95b-48ce-bd01-5c5c161051cb"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:10:25.112442 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-f03694cc-d46e-4dcc-ac00-37f70887f4ba req-d0bdc8de-8689-4443-88d8-c05939bd58ad service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:25.113376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-f03694cc-d46e-4dcc-ac00-37f70887f4ba req-d0bdc8de-8689-4443-88d8-c05939bd58ad service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:25.127393 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-f03694cc-d46e-4dcc-ac00-37f70887f4ba req-d0bdc8de-8689-4443-88d8-c05939bd58ad service nova] Creating event network-changed:af478c0c-b95b-48ce-bd01-5c5c161051cb for instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b on hv-cinder-83754 Jul 28 18:10:25.139166 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-f03694cc-d46e-4dcc-ac00-37f70887f4ba req-d0bdc8de-8689-4443-88d8-c05939bd58ad service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043731 Jul 28 18:10:25.140153 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 483/980] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:10:25.418823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-d3431a31-c898-4c1a-998d-346a3db7d6de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:25.419484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-d3431a31-c898-4c1a-998d-346a3db7d6de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:25.426739 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d3431a31-c898-4c1a-998d-346a3db7d6de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:25.427190 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d3431a31-c898-4c1a-998d-346a3db7d6de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:25.427970 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d3431a31-c898-4c1a-998d-346a3db7d6de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:25.428408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-d3431a31-c898-4c1a-998d-346a3db7d6de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:25.598931 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-d3431a31-c898-4c1a-998d-346a3db7d6de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:25.607013 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-d3431a31-c898-4c1a-998d-346a3db7d6de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.192009 Jul 28 18:10:25.607579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 498/981] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:25 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:26.628720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8e71f762-f67d-4d52-b350-cc9613605369 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:26.629420 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8e71f762-f67d-4d52-b350-cc9613605369 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:26.635641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8e71f762-f67d-4d52-b350-cc9613605369 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:26.637838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8e71f762-f67d-4d52-b350-cc9613605369 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:26.637838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8e71f762-f67d-4d52-b350-cc9613605369 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:26.637838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8e71f762-f67d-4d52-b350-cc9613605369 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:26.769781 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8e71f762-f67d-4d52-b350-cc9613605369 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:26.777463 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8e71f762-f67d-4d52-b350-cc9613605369 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.153736 Jul 28 18:10:26.778032 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 484/982] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:26 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:10:27.799269 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-94f57aa9-c154-4a28-92b3-1a8b8209f76d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:27.799834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-94f57aa9-c154-4a28-92b3-1a8b8209f76d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:27.806280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-94f57aa9-c154-4a28-92b3-1a8b8209f76d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:27.806763 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-94f57aa9-c154-4a28-92b3-1a8b8209f76d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:27.807518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-94f57aa9-c154-4a28-92b3-1a8b8209f76d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:27.807949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-94f57aa9-c154-4a28-92b3-1a8b8209f76d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:27.940582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-94f57aa9-c154-4a28-92b3-1a8b8209f76d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:27.947994 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-94f57aa9-c154-4a28-92b3-1a8b8209f76d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.152718 Jul 28 18:10:27.948550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 499/983] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:27 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:28.970361 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-271c7f18-26f9-49bd-869f-8230bdd90f79 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:28.971380 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-271c7f18-26f9-49bd-869f-8230bdd90f79 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:28.978663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-271c7f18-26f9-49bd-869f-8230bdd90f79 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:28.979114 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-271c7f18-26f9-49bd-869f-8230bdd90f79 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:28.979890 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-271c7f18-26f9-49bd-869f-8230bdd90f79 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:28.980324 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-271c7f18-26f9-49bd-869f-8230bdd90f79 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:29.138661 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-271c7f18-26f9-49bd-869f-8230bdd90f79 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:29.146937 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-271c7f18-26f9-49bd-869f-8230bdd90f79 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.181270 Jul 28 18:10:29.147508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 485/984] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:28 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:30.169453 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-60eba540-9df7-491c-9ebe-c26d3b010f4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:30.170069 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-60eba540-9df7-491c-9ebe-c26d3b010f4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:30.177896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-60eba540-9df7-491c-9ebe-c26d3b010f4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:30.178362 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-60eba540-9df7-491c-9ebe-c26d3b010f4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:30.179180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-60eba540-9df7-491c-9ebe-c26d3b010f4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:30.179620 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-60eba540-9df7-491c-9ebe-c26d3b010f4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:30.317789 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-60eba540-9df7-491c-9ebe-c26d3b010f4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:30.325182 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-60eba540-9df7-491c-9ebe-c26d3b010f4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.160249 Jul 28 18:10:30.325744 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 500/985] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:30 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:31.347078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-69b37084-a0e3-4b36-8e7d-6c6825710dee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:31.347620 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-69b37084-a0e3-4b36-8e7d-6c6825710dee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:31.350054 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:31.355211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-69b37084-a0e3-4b36-8e7d-6c6825710dee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:31.355657 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-69b37084-a0e3-4b36-8e7d-6c6825710dee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:31.357948 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-69b37084-a0e3-4b36-8e7d-6c6825710dee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:31.357948 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-69b37084-a0e3-4b36-8e7d-6c6825710dee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:31.489507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-69b37084-a0e3-4b36-8e7d-6c6825710dee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:31.497210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-69b37084-a0e3-4b36-8e7d-6c6825710dee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.154799 Jul 28 18:10:31.501235 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 486/986] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:31 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:31.978509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-552ab4bf-9ee2-4c49-b4e2-174784aaab8a req-f4d994e1-6867-44c2-a2a5-16f1813b8c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9e762e-5473-4949-8d19-ff0bfe5bb52b", "name": "network-vif-plugged", "status": "completed", "tag": "af478c0c-b95b-48ce-bd01-5c5c161051cb"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:10:31.985270 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:31.987966 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=10 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:31.990598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-552ab4bf-9ee2-4c49-b4e2-174784aaab8a req-f4d994e1-6867-44c2-a2a5-16f1813b8c29 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:31.991041 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-552ab4bf-9ee2-4c49-b4e2-174784aaab8a req-f4d994e1-6867-44c2-a2a5-16f1813b8c29 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:32.002487 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-552ab4bf-9ee2-4c49-b4e2-174784aaab8a req-f4d994e1-6867-44c2-a2a5-16f1813b8c29 service nova] Creating event network-vif-plugged:af478c0c-b95b-48ce-bd01-5c5c161051cb for instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b on hv-cinder-83754 Jul 28 18:10:32.007460 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-552ab4bf-9ee2-4c49-b4e2-174784aaab8a req-f4d994e1-6867-44c2-a2a5-16f1813b8c29 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032894 Jul 28 18:10:32.010961 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 501/987] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:10:32.519319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9fd0b167-0600-4edc-aec8-cc0eef717b66 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:32.520095 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9fd0b167-0600-4edc-aec8-cc0eef717b66 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:32.528916 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9fd0b167-0600-4edc-aec8-cc0eef717b66 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:32.529527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9fd0b167-0600-4edc-aec8-cc0eef717b66 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:32.530501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9fd0b167-0600-4edc-aec8-cc0eef717b66 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:32.531009 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9fd0b167-0600-4edc-aec8-cc0eef717b66 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:32.533762 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:32.669880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9fd0b167-0600-4edc-aec8-cc0eef717b66 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:32.677797 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9fd0b167-0600-4edc-aec8-cc0eef717b66 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.163054 Jul 28 18:10:32.678369 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 487/988] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:32 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:33.700550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7dde5bbf-36d3-4a13-a315-b27145a3c106 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:33.701297 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7dde5bbf-36d3-4a13-a315-b27145a3c106 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:33.703839 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:33.709067 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7dde5bbf-36d3-4a13-a315-b27145a3c106 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:33.709586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7dde5bbf-36d3-4a13-a315-b27145a3c106 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:33.710386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7dde5bbf-36d3-4a13-a315-b27145a3c106 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:33.710817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7dde5bbf-36d3-4a13-a315-b27145a3c106 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:33.714682 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=91 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:33.856698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7dde5bbf-36d3-4a13-a315-b27145a3c106 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:33.865090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7dde5bbf-36d3-4a13-a315-b27145a3c106 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1365 microversion: 2.1 time: 0.169354 Jul 28 18:10:33.865876 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 502/989] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:33 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:34.885859 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-44613f0b-a73e-4666-aafe-6625d9ab6533 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:34.886482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-44613f0b-a73e-4666-aafe-6625d9ab6533 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:34.889085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:34.894133 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44613f0b-a73e-4666-aafe-6625d9ab6533 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:34.894605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44613f0b-a73e-4666-aafe-6625d9ab6533 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:34.895367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44613f0b-a73e-4666-aafe-6625d9ab6533 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:34.895826 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-44613f0b-a73e-4666-aafe-6625d9ab6533 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:35.026658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-44613f0b-a73e-4666-aafe-6625d9ab6533 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:10:35.034606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-44613f0b-a73e-4666-aafe-6625d9ab6533 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1555 microversion: 2.1 time: 0.152717 Jul 28 18:10:35.035158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 488/990] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:10:34 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:10:35.055625 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-539230d6-b300-4754-825f-975fa065675d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:35.056125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-539230d6-b300-4754-825f-975fa065675d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:35.062796 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-539230d6-b300-4754-825f-975fa065675d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:35.063874 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-539230d6-b300-4754-825f-975fa065675d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:35.064651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-539230d6-b300-4754-825f-975fa065675d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:35.065088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-539230d6-b300-4754-825f-975fa065675d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:35.144212 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-539230d6-b300-4754-825f-975fa065675d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092620 Jul 28 18:10:35.144809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 503/991] 10.222.0.85 () {58 vars in 1275 bytes} [Thu Jul 28 18:10:35 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:10:36.138945 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-d2b84223-dcdc-4c09-bf67-9d67470d6044 req-40b04c82-0e70-4a57-adda-105d980cb18c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f9e762e-5473-4949-8d19-ff0bfe5bb52b", "tag": "af478c0c-b95b-48ce-bd01-5c5c161051cb"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:10:36.149755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-d2b84223-dcdc-4c09-bf67-9d67470d6044 req-40b04c82-0e70-4a57-adda-105d980cb18c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:36.151473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-d2b84223-dcdc-4c09-bf67-9d67470d6044 req-40b04c82-0e70-4a57-adda-105d980cb18c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:36.161848 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-d2b84223-dcdc-4c09-bf67-9d67470d6044 req-40b04c82-0e70-4a57-adda-105d980cb18c service nova] Creating event network-changed:af478c0c-b95b-48ce-bd01-5c5c161051cb for instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b on hv-cinder-83754 Jul 28 18:10:36.166793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-d2b84223-dcdc-4c09-bf67-9d67470d6044 req-40b04c82-0e70-4a57-adda-105d980cb18c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031472 Jul 28 18:10:36.167408 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 489/992] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:10:58.007989 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:58.008753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=9 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:10:58.012798 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-16d67838-ab43-4f72-9df7-eac0ff0ab700 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:10:58.013291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-16d67838-ab43-4f72-9df7-eac0ff0ab700 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:10:58.019173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-16d67838-ab43-4f72-9df7-eac0ff0ab700 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:58.020872 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-16d67838-ab43-4f72-9df7-eac0ff0ab700 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:58.020872 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-16d67838-ab43-4f72-9df7-eac0ff0ab700 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:10:58.020872 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-16d67838-ab43-4f72-9df7-eac0ff0ab700 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:10:58.102773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-16d67838-ab43-4f72-9df7-eac0ff0ab700 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lazy-loading 'services' on Instance uuid 875a9106-a56f-4acb-9056-7672341ebccc {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:10:58.326287 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-16d67838-ab43-4f72-9df7-eac0ff0ab700 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/os-volume_attachments/811c9216-7b65-4cab-9d60-93e38dbaa62c" status: 202 len: 0 microversion: 2.1 time: 0.319441 Jul 28 18:10:58.327033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 504/993] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:10:58 2022] DELETE /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/os-volume_attachments/811c9216-7b65-4cab-9d60-93e38dbaa62c => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:11:00.510658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=3 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:00.511484 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=13 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:00.515737 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a88c9396-801f-4d68-a77b-1ec2fee249de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:00.521878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a88c9396-801f-4d68-a77b-1ec2fee249de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:00.528979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a88c9396-801f-4d68-a77b-1ec2fee249de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:00.544559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a88c9396-801f-4d68-a77b-1ec2fee249de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Going to try to stop instance {{(pid=130401) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 18:11:00.770161 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a88c9396-801f-4d68-a77b-1ec2fee249de tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/action" status: 202 len: 0 microversion: 2.1 time: 0.260938 Jul 28 18:11:00.770802 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 490/994] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:11:00 2022] POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:11:00.780735 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0f3f4e7c-d0c2-401e-bac0-ced9e1368083 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:00.781445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0f3f4e7c-d0c2-401e-bac0-ced9e1368083 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:00.788116 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0f3f4e7c-d0c2-401e-bac0-ced9e1368083 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:00.789051 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0f3f4e7c-d0c2-401e-bac0-ced9e1368083 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:00.790255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0f3f4e7c-d0c2-401e-bac0-ced9e1368083 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:00.790724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0f3f4e7c-d0c2-401e-bac0-ced9e1368083 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:00.979411 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0f3f4e7c-d0c2-401e-bac0-ced9e1368083 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:00.987128 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0f3f4e7c-d0c2-401e-bac0-ced9e1368083 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.211390 Jul 28 18:11:00.987693 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 505/995] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:00 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:02.009848 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-65707ba1-9b33-4b4f-9e1a-2d2a95f638cc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:02.010580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-65707ba1-9b33-4b4f-9e1a-2d2a95f638cc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:02.017263 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-65707ba1-9b33-4b4f-9e1a-2d2a95f638cc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:02.017722 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-65707ba1-9b33-4b4f-9e1a-2d2a95f638cc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:02.018569 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-65707ba1-9b33-4b4f-9e1a-2d2a95f638cc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:02.019011 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-65707ba1-9b33-4b4f-9e1a-2d2a95f638cc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:02.150839 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-65707ba1-9b33-4b4f-9e1a-2d2a95f638cc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:02.160216 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-65707ba1-9b33-4b4f-9e1a-2d2a95f638cc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.155212 Jul 28 18:11:02.160801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 491/996] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:02 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:03.180514 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f70ac2f8-1a1c-4fb6-8aec-f62c17939b14 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:03.181147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f70ac2f8-1a1c-4fb6-8aec-f62c17939b14 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:03.187772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f70ac2f8-1a1c-4fb6-8aec-f62c17939b14 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:03.188223 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f70ac2f8-1a1c-4fb6-8aec-f62c17939b14 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:03.188986 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f70ac2f8-1a1c-4fb6-8aec-f62c17939b14 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:03.189425 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f70ac2f8-1a1c-4fb6-8aec-f62c17939b14 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:03.321882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f70ac2f8-1a1c-4fb6-8aec-f62c17939b14 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:03.329364 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f70ac2f8-1a1c-4fb6-8aec-f62c17939b14 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.152785 Jul 28 18:11:03.329922 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 506/997] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:03 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:04.352072 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-079887ad-091a-4efd-8fa9-49251194c3c7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:04.352683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-079887ad-091a-4efd-8fa9-49251194c3c7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:04.359235 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-079887ad-091a-4efd-8fa9-49251194c3c7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:04.361148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-079887ad-091a-4efd-8fa9-49251194c3c7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:04.361148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-079887ad-091a-4efd-8fa9-49251194c3c7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:04.361148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-079887ad-091a-4efd-8fa9-49251194c3c7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:04.499665 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-079887ad-091a-4efd-8fa9-49251194c3c7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:04.507313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-079887ad-091a-4efd-8fa9-49251194c3c7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.159870 Jul 28 18:11:04.510186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 492/998] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:04 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:05.528744 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-02c1f5f0-0070-4bbf-b508-2ed265947545 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:05.529357 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-02c1f5f0-0070-4bbf-b508-2ed265947545 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:05.535587 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-02c1f5f0-0070-4bbf-b508-2ed265947545 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:05.536047 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-02c1f5f0-0070-4bbf-b508-2ed265947545 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:05.536800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-02c1f5f0-0070-4bbf-b508-2ed265947545 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:05.537230 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-02c1f5f0-0070-4bbf-b508-2ed265947545 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:05.668733 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-02c1f5f0-0070-4bbf-b508-2ed265947545 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:05.676284 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-02c1f5f0-0070-4bbf-b508-2ed265947545 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.151403 Jul 28 18:11:05.676841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 507/999] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:05 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:06.700606 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-91fe797f-3eca-4fbf-8492-6df4f7cfe7e9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:06.701269 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-91fe797f-3eca-4fbf-8492-6df4f7cfe7e9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:06.707795 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-91fe797f-3eca-4fbf-8492-6df4f7cfe7e9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:06.708251 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-91fe797f-3eca-4fbf-8492-6df4f7cfe7e9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:06.709014 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-91fe797f-3eca-4fbf-8492-6df4f7cfe7e9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:06.709453 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-91fe797f-3eca-4fbf-8492-6df4f7cfe7e9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:06.840058 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-91fe797f-3eca-4fbf-8492-6df4f7cfe7e9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:06.847523 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-91fe797f-3eca-4fbf-8492-6df4f7cfe7e9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.151391 Jul 28 18:11:06.848083 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 493/1000] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:06 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:07.867953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3788d86e-3d7a-4c3c-b2fa-b6b87eacc60b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:07.868586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3788d86e-3d7a-4c3c-b2fa-b6b87eacc60b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:07.875178 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3788d86e-3d7a-4c3c-b2fa-b6b87eacc60b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:07.875624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3788d86e-3d7a-4c3c-b2fa-b6b87eacc60b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:07.876385 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3788d86e-3d7a-4c3c-b2fa-b6b87eacc60b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:07.876821 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3788d86e-3d7a-4c3c-b2fa-b6b87eacc60b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:08.011698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3788d86e-3d7a-4c3c-b2fa-b6b87eacc60b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:08.019371 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3788d86e-3d7a-4c3c-b2fa-b6b87eacc60b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.155301 Jul 28 18:11:08.019934 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 508/1001] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:07 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:09.041313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-32770054-7d3b-43f5-8e60-392894118325 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:09.042802 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-32770054-7d3b-43f5-8e60-392894118325 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:09.049336 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-32770054-7d3b-43f5-8e60-392894118325 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:09.049779 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-32770054-7d3b-43f5-8e60-392894118325 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:09.050576 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-32770054-7d3b-43f5-8e60-392894118325 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:09.051005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-32770054-7d3b-43f5-8e60-392894118325 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:09.183455 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-32770054-7d3b-43f5-8e60-392894118325 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:09.190915 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-32770054-7d3b-43f5-8e60-392894118325 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.153404 Jul 28 18:11:09.191475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 494/1002] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:09 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:10.212150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-61cd859d-2f55-4a4c-b549-3e8ad75b4a26 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:10.212693 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-61cd859d-2f55-4a4c-b549-3e8ad75b4a26 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:10.221103 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-61cd859d-2f55-4a4c-b549-3e8ad75b4a26 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:10.221548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-61cd859d-2f55-4a4c-b549-3e8ad75b4a26 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:10.222316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-61cd859d-2f55-4a4c-b549-3e8ad75b4a26 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:10.222772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-61cd859d-2f55-4a4c-b549-3e8ad75b4a26 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:10.353958 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-61cd859d-2f55-4a4c-b549-3e8ad75b4a26 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:10.361778 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-61cd859d-2f55-4a4c-b549-3e8ad75b4a26 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1676 microversion: 2.1 time: 0.153649 Jul 28 18:11:10.362342 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 509/1003] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:10 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:11.383271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-51ad60b7-eabe-4fa8-9ee3-0d8cd276d223 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:11.383859 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-51ad60b7-eabe-4fa8-9ee3-0d8cd276d223 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:11.391322 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-51ad60b7-eabe-4fa8-9ee3-0d8cd276d223 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:11.391765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-51ad60b7-eabe-4fa8-9ee3-0d8cd276d223 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:11.392526 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-51ad60b7-eabe-4fa8-9ee3-0d8cd276d223 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:11.392956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-51ad60b7-eabe-4fa8-9ee3-0d8cd276d223 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:11.524583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-51ad60b7-eabe-4fa8-9ee3-0d8cd276d223 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:11.532761 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-51ad60b7-eabe-4fa8-9ee3-0d8cd276d223 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1653 microversion: 2.1 time: 0.153385 Jul 28 18:11:11.533332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 495/1004] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:11 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1653 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:11.554153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e4cc59d5-3717-40f5-8693-12ee7368be4d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:11.561415 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e4cc59d5-3717-40f5-8693-12ee7368be4d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:11.561875 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e4cc59d5-3717-40f5-8693-12ee7368be4d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:11.586022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e4cc59d5-3717-40f5-8693-12ee7368be4d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Going to try to start instance {{(pid=130400) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 18:11:11.757708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e4cc59d5-3717-40f5-8693-12ee7368be4d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/action" status: 202 len: 0 microversion: 2.1 time: 0.207224 Jul 28 18:11:11.758498 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 510/1005] 10.222.0.85 () {60 vars in 1278 bytes} [Thu Jul 28 18:11:11 2022] POST /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:11:11.768389 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e9a54a82-581e-408e-a2d0-e1dc28a17daa tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:11.769469 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e9a54a82-581e-408e-a2d0-e1dc28a17daa tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:11.777968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e9a54a82-581e-408e-a2d0-e1dc28a17daa tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:11.778479 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e9a54a82-581e-408e-a2d0-e1dc28a17daa tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:11.779268 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e9a54a82-581e-408e-a2d0-e1dc28a17daa tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:11.779724 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e9a54a82-581e-408e-a2d0-e1dc28a17daa tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:11.917765 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e9a54a82-581e-408e-a2d0-e1dc28a17daa tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:11.926383 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e9a54a82-581e-408e-a2d0-e1dc28a17daa tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1662 microversion: 2.1 time: 0.162429 Jul 28 18:11:11.926969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 496/1006] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:11 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:12.016521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-74c4dd5e-ca45-454d-a764-dbd8fe5dae0e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:12.017045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-74c4dd5e-ca45-454d-a764-dbd8fe5dae0e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:12.023264 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-74c4dd5e-ca45-454d-a764-dbd8fe5dae0e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:12.023724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-74c4dd5e-ca45-454d-a764-dbd8fe5dae0e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:12.024484 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-74c4dd5e-ca45-454d-a764-dbd8fe5dae0e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:12.024914 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-74c4dd5e-ca45-454d-a764-dbd8fe5dae0e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:12.050941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-74c4dd5e-ca45-454d-a764-dbd8fe5dae0e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/ips" status: 200 len: 149 microversion: 2.1 time: 0.038596 Jul 28 18:11:12.051516 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 511/1007] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:11:12 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:12.947993 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-36c4a16e-93ce-499d-b79a-ceb4bbfbcfa3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:12.949630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-36c4a16e-93ce-499d-b79a-ceb4bbfbcfa3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:12.955750 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-36c4a16e-93ce-499d-b79a-ceb4bbfbcfa3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:12.964198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-36c4a16e-93ce-499d-b79a-ceb4bbfbcfa3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:12.964198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-36c4a16e-93ce-499d-b79a-ceb4bbfbcfa3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:12.964198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-36c4a16e-93ce-499d-b79a-ceb4bbfbcfa3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:13.089097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-36c4a16e-93ce-499d-b79a-ceb4bbfbcfa3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:13.096658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-36c4a16e-93ce-499d-b79a-ceb4bbfbcfa3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1662 microversion: 2.1 time: 0.152572 Jul 28 18:11:13.097185 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 497/1008] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:12 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:13.829641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4b8678b7-3228-42de-aae5-b00c3c90e4a4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69ba3d7-978f-49d5-8ba6-6e571d56eb71"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:13.832056 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4b8678b7-3228-42de-aae5-b00c3c90e4a4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:13.838893 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4b8678b7-3228-42de-aae5-b00c3c90e4a4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:13.839345 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4b8678b7-3228-42de-aae5-b00c3c90e4a4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:13.840193 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4b8678b7-3228-42de-aae5-b00c3c90e4a4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:13.840554 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4b8678b7-3228-42de-aae5-b00c3c90e4a4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:14.118662 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ab7bb972-8d76-47c3-aa2f-65e4cda3442b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:14.119276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ab7bb972-8d76-47c3-aa2f-65e4cda3442b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:14.126313 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab7bb972-8d76-47c3-aa2f-65e4cda3442b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:14.126807 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab7bb972-8d76-47c3-aa2f-65e4cda3442b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:14.127568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab7bb972-8d76-47c3-aa2f-65e4cda3442b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:14.128001 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab7bb972-8d76-47c3-aa2f-65e4cda3442b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:14.256501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ab7bb972-8d76-47c3-aa2f-65e4cda3442b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:14.264736 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ab7bb972-8d76-47c3-aa2f-65e4cda3442b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1666 microversion: 2.1 time: 0.150002 Jul 28 18:11:14.265303 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 498/1009] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:14 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:14.524318 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4b8678b7-3228-42de-aae5-b00c3c90e4a4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.698421 Jul 28 18:11:14.525780 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 512/1010] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:11:13 2022] POST /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments => generated 194 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:16.323617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-71bb0fae-7e61-4d32-bc90-f3ca025f8a19 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:16.324310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-71bb0fae-7e61-4d32-bc90-f3ca025f8a19 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:16.329772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-56811089-8f46-44f1-9a19-0383cb8872f1 req-06babcfd-6c57-41cc-9081-421ccd40c131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08e56a37-546f-4aa0-a30d-7e0108b17796", "tag": "d86bf1f7-161e-40c1-a007-0a9f75542440"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:16.331018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-71bb0fae-7e61-4d32-bc90-f3ca025f8a19 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:16.331495 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-71bb0fae-7e61-4d32-bc90-f3ca025f8a19 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:16.332410 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-71bb0fae-7e61-4d32-bc90-f3ca025f8a19 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:16.332876 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-71bb0fae-7e61-4d32-bc90-f3ca025f8a19 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:16.340595 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-56811089-8f46-44f1-9a19-0383cb8872f1 req-06babcfd-6c57-41cc-9081-421ccd40c131 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:16.341032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-56811089-8f46-44f1-9a19-0383cb8872f1 req-06babcfd-6c57-41cc-9081-421ccd40c131 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:16.353607 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-56811089-8f46-44f1-9a19-0383cb8872f1 req-06babcfd-6c57-41cc-9081-421ccd40c131 service nova] Creating event network-changed:d86bf1f7-161e-40c1-a007-0a9f75542440 for instance 08e56a37-546f-4aa0-a30d-7e0108b17796 on hv-cinder-83754 Jul 28 18:11:16.359697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-56811089-8f46-44f1-9a19-0383cb8872f1 req-06babcfd-6c57-41cc-9081-421ccd40c131 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041424 Jul 28 18:11:16.360548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 513/1011] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:16.362711 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-71bb0fae-7e61-4d32-bc90-f3ca025f8a19 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:11:16.623237 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-71bb0fae-7e61-4d32-bc90-f3ca025f8a19 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "DELETE /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 204 len: 0 microversion: 2.1 time: 0.307390 Jul 28 18:11:16.624422 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 499/1012] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:11:16 2022] DELETE /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:11:16.633380 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fb6d76db-a622-4a90-a135-cce5818086e7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:16.634186 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fb6d76db-a622-4a90-a135-cce5818086e7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:16.641074 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fb6d76db-a622-4a90-a135-cce5818086e7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:16.641596 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fb6d76db-a622-4a90-a135-cce5818086e7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:16.642460 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fb6d76db-a622-4a90-a135-cce5818086e7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:16.642960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fb6d76db-a622-4a90-a135-cce5818086e7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:16.792921 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fb6d76db-a622-4a90-a135-cce5818086e7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:16.800616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fb6d76db-a622-4a90-a135-cce5818086e7 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.171435 Jul 28 18:11:16.801212 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 514/1013] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:16 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:17.825718 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f36c3c5b-444a-4081-847d-70a5abc2bc29 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:17.826756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f36c3c5b-444a-4081-847d-70a5abc2bc29 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:17.834306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f36c3c5b-444a-4081-847d-70a5abc2bc29 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:17.834831 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f36c3c5b-444a-4081-847d-70a5abc2bc29 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:17.835708 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f36c3c5b-444a-4081-847d-70a5abc2bc29 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:17.836207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f36c3c5b-444a-4081-847d-70a5abc2bc29 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:17.982842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f36c3c5b-444a-4081-847d-70a5abc2bc29 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:17.990886 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f36c3c5b-444a-4081-847d-70a5abc2bc29 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1566 microversion: 2.1 time: 0.170114 Jul 28 18:11:17.991513 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 500/1014] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:17 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:18.849518 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-f479d216-4c3f-4f2e-8725-39e4cbfa5b5d req-b047a9dc-0c94-4e40-9571-842136d86c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08e56a37-546f-4aa0-a30d-7e0108b17796", "name": "network-vif-deleted", "tag": "d86bf1f7-161e-40c1-a007-0a9f75542440"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:18.860571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-f479d216-4c3f-4f2e-8725-39e4cbfa5b5d req-b047a9dc-0c94-4e40-9571-842136d86c2c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:18.861008 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-f479d216-4c3f-4f2e-8725-39e4cbfa5b5d req-b047a9dc-0c94-4e40-9571-842136d86c2c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:18.872399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-f479d216-4c3f-4f2e-8725-39e4cbfa5b5d req-b047a9dc-0c94-4e40-9571-842136d86c2c service nova] Creating event network-vif-deleted:d86bf1f7-161e-40c1-a007-0a9f75542440 for instance 08e56a37-546f-4aa0-a30d-7e0108b17796 on hv-cinder-83754 Jul 28 18:11:18.877442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-f479d216-4c3f-4f2e-8725-39e4cbfa5b5d req-b047a9dc-0c94-4e40-9571-842136d86c2c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047420 Jul 28 18:11:18.878023 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 515/1015] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:19.127762 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8fd69aea-450c-4e2f-a59f-878d3f33599a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:19.128373 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8fd69aea-450c-4e2f-a59f-878d3f33599a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:19.137257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fd69aea-450c-4e2f-a59f-878d3f33599a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:19.137841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fd69aea-450c-4e2f-a59f-878d3f33599a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:19.138697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fd69aea-450c-4e2f-a59f-878d3f33599a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:19.139140 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8fd69aea-450c-4e2f-a59f-878d3f33599a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:19.212189 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8fd69aea-450c-4e2f-a59f-878d3f33599a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:19.220609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8fd69aea-450c-4e2f-a59f-878d3f33599a tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1218 microversion: 2.1 time: 0.211649 Jul 28 18:11:19.221234 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 501/1016] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:19 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1218 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:20.245339 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:20.246134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:20.252409 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:20.252883 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:20.253649 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:20.254100 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:20.289093 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:20.289530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:20.289975 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lazy-loading 'fault' on Instance uuid 08e56a37-546f-4aa0-a30d-7e0108b17796 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:11:20.336365 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '186ea84ee37d48c186190438adce39b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa7968cb99d4470b48f8ff2fd8bad7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:20.344246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-eda6c684-1698-4d08-84f4-31097b9cf3c2 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 200 len: 1223 microversion: 2.1 time: 0.104322 Jul 28 18:11:20.348299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 516/1017] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:20 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:21.366685 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:21.367343 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] [instance: 08e56a37-546f-4aa0-a30d-7e0108b17796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:21.373680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:21.374133 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:21.374938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:21.375377 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:21.389857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] HTTP exception thrown: Instance 08e56a37-546f-4aa0-a30d-7e0108b17796 could not be found. Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Request method failure captured: Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 HTTP/1.1 Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tAUbP0wCx50D-S5TclkBXsr-Q_FvUIvmcu-tEgsKdSKIMkbU3SMzk798e_Xw_ZkNCDw7uPzrqV_TBNUsTvstxVuYqW-Mtl-1ySmy51ZIqfIxxDIOD36PCHIGnhHwm2OtUs53hCADvsNB8Q8HZkTGTFMPQ6QCd4yR22UO8TzQlWY_Eo Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: efa7968cb99d4470b48f8ff2fd8bad7a Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-TestShelveInstance-1665381570 Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:11:21.391539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/efa7968cb99d4470b48f8ff2fd8bad7a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_efa7968cb99d4470b48f8ff2fd8bad7a", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/efa7968cb99d4470b48f8ff2fd8bad7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/efa7968cb99d4470b48f8ff2fd8bad7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-TestShelveInstance-1665381570 Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: efa7968cb99d4470b48f8ff2fd8bad7a Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-TestShelveInstance-1665381570 Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-TestShelveInstance-1665381570-project Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 186ea84ee37d48c186190438adce39b9 Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-TestShelveInstance-1665381570-project Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 08e56a37-546f-4aa0-a30d-7e0108b17796 could not be found. Jul 28 18:11:21.393707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '08e56a37-546f-4aa0-a30d-7e0108b17796'} Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08e56a37-546f-4aa0-a30d-7e0108b17796 could not be found. Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:11:21.395089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08e56a37-546f-4aa0-a30d-7e0108b17796 could not be found. Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08e56a37-546f-4aa0-a30d-7e0108b17796 could not be found. Jul 28 18:11:21.398105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:21.400042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Returning 404 to user: Instance 08e56a37-546f-4aa0-a30d-7e0108b17796 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:11:21.400042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2bfb7ff5-c9f3-4f93-944f-c4562180e818 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796" status: 404 len: 111 microversion: 2.1 time: 0.030471 Jul 28 18:11:21.400042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 502/1018] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:21 2022] GET /compute/v2.1/servers/08e56a37-546f-4aa0-a30d-7e0108b17796 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:11:21.664541 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e10358a5-aa50-45f6-bab8-061fd07d47b8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] Calling method '.version_select at 0x7fdae03d80d0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:21.763347 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e10358a5-aa50-45f6-bab8-061fd07d47b8 tempest-TestShelveInstance-1665381570 tempest-TestShelveInstance-1665381570-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-673230153" status: 202 len: 0 microversion: 2.1 time: 0.104457 Jul 28 18:11:21.763936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 517/1019] 10.222.0.85 () {58 vars in 1251 bytes} [Thu Jul 28 18:11:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-673230153 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:11:22.137164 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f06eae14-92a9-440e-aeaf-b5e2f19265cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: .version_select at 0x7fdae02cf790>, body: {"keypair": {"name": "tempest-keypair-1178383770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGNw8rQRxHH+8kP9H11WTD8Mv0DVKI2VgDaonoy8G4dqrrU36BnfzSCSeZV6ey4upwj9r40DPumohLHR+0Mnm/rc3yDI8ELxRKEr3ZzCXG8uHAHTC0j6P8uLvTrtZHXpw=="}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:22.153832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-f06eae14-92a9-440e-aeaf-b5e2f19265cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:11:22.157838 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-f06eae14-92a9-440e-aeaf-b5e2f19265cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for user de20d8b31db44abf91a482d81b898755 and project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:11:22.224564 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f06eae14-92a9-440e-aeaf-b5e2f19265cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091929 Jul 28 18:11:22.225572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 503/1020] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:11:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:24.645321 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-176143603", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a1ed8c2-e3be-47b5-8608-0f5e33222798"}], "security_groups": [{"name": "tempest-securitygroup--1686377060"}], "key_name": "tempest-keypair-1178383770", "user_data": "}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:24.774229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] validate_networks() for [('7a1ed8c2-e3be-47b5-8608-0f5e33222798', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:11:25.250766 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:11:25.254734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:11:25.254734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:11:25.254734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:11:25.254734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:11:25.268276 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:25.268722 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:25.269567 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:25.269963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:25.305009 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:11:25.311729 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for user de20d8b31db44abf91a482d81b898755 and project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:11:25.334928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:11:25.342106 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:11:25.511229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1ac22a8c-7ccc-43b0-9c4a-8e3224bc4756 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.870166 Jul 28 18:11:25.521051 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 518/1021] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:11:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:11:25.529844 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a4877918-ebea-4a5b-ab1b-bbe5d23d2d76 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:25.532449 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a4877918-ebea-4a5b-ab1b-bbe5d23d2d76 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:25.606833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a4877918-ebea-4a5b-ab1b-bbe5d23d2d76 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:25.613500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a4877918-ebea-4a5b-ab1b-bbe5d23d2d76 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1241 microversion: 2.1 time: 0.090460 Jul 28 18:11:25.626820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 504/1022] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:25 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:26.636554 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3da20368-24cb-45af-9611-47e3955ebc48 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:26.637438 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3da20368-24cb-45af-9611-47e3955ebc48 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:26.682167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3da20368-24cb-45af-9611-47e3955ebc48 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:26.682821 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3da20368-24cb-45af-9611-47e3955ebc48 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:26.683843 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3da20368-24cb-45af-9611-47e3955ebc48 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:26.684308 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3da20368-24cb-45af-9611-47e3955ebc48 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:26.785052 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3da20368-24cb-45af-9611-47e3955ebc48 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:26.805108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3da20368-24cb-45af-9611-47e3955ebc48 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1237 microversion: 2.1 time: 0.173259 Jul 28 18:11:26.805697 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 519/1023] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:26 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1237 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:27.828064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a65d0a98-dbc9-4e70-872a-7bcd80f34871 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:27.828684 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a65d0a98-dbc9-4e70-872a-7bcd80f34871 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:27.838856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a65d0a98-dbc9-4e70-872a-7bcd80f34871 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:27.839613 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a65d0a98-dbc9-4e70-872a-7bcd80f34871 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:27.842426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a65d0a98-dbc9-4e70-872a-7bcd80f34871 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:27.843125 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a65d0a98-dbc9-4e70-872a-7bcd80f34871 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:27.922383 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a65d0a98-dbc9-4e70-872a-7bcd80f34871 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:27.933755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a65d0a98-dbc9-4e70-872a-7bcd80f34871 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1311 microversion: 2.1 time: 0.110092 Jul 28 18:11:27.934595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 505/1024] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:27 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:28.957079 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-db2c6c10-12ea-464e-a630-6aa5e98c4981 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:28.960522 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-db2c6c10-12ea-464e-a630-6aa5e98c4981 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:28.960666 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:28.967901 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-db2c6c10-12ea-464e-a630-6aa5e98c4981 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:28.968514 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-db2c6c10-12ea-464e-a630-6aa5e98c4981 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:28.969492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-db2c6c10-12ea-464e-a630-6aa5e98c4981 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:28.970025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-db2c6c10-12ea-464e-a630-6aa5e98c4981 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:28.975373 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:29.380632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-db2c6c10-12ea-464e-a630-6aa5e98c4981 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:29.380632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-db2c6c10-12ea-464e-a630-6aa5e98c4981 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.415889 Jul 28 18:11:29.380632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 520/1025] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:28 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:30.390893 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8861e93e-5b33-458c-9efb-19f22ad68c12 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:30.391867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8861e93e-5b33-458c-9efb-19f22ad68c12 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:30.411427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8861e93e-5b33-458c-9efb-19f22ad68c12 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:30.412201 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8861e93e-5b33-458c-9efb-19f22ad68c12 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:30.413680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8861e93e-5b33-458c-9efb-19f22ad68c12 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:30.414173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8861e93e-5b33-458c-9efb-19f22ad68c12 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:30.447807 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:30.679401 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8861e93e-5b33-458c-9efb-19f22ad68c12 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:30.689898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8861e93e-5b33-458c-9efb-19f22ad68c12 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.302693 Jul 28 18:11:30.695129 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 506/1026] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:30 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:30.725446 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-94b558e8-f600-4430-986a-3f12e83fc033 req-0ab05237-230e-43fd-b0ac-205f86eb13a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49c8f7f-b382-4cbe-a1b0-3483b3d21273", "tag": "c0ced40c-6170-4e06-befd-26d27f4c9ad3"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:30.758058 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-94b558e8-f600-4430-986a-3f12e83fc033 req-0ab05237-230e-43fd-b0ac-205f86eb13a5 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:30.758535 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-94b558e8-f600-4430-986a-3f12e83fc033 req-0ab05237-230e-43fd-b0ac-205f86eb13a5 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:30.782969 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-94b558e8-f600-4430-986a-3f12e83fc033 req-0ab05237-230e-43fd-b0ac-205f86eb13a5 service nova] Creating event network-changed:c0ced40c-6170-4e06-befd-26d27f4c9ad3 for instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 on hv-cinder-83754 Jul 28 18:11:30.802330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-94b558e8-f600-4430-986a-3f12e83fc033 req-0ab05237-230e-43fd-b0ac-205f86eb13a5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082454 Jul 28 18:11:30.808816 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 521/1027] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:31.712266 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-21c0d105-a1bd-419f-9f05-22c5b2d579ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:31.713326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-21c0d105-a1bd-419f-9f05-22c5b2d579ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:31.715943 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:31.722233 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-21c0d105-a1bd-419f-9f05-22c5b2d579ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:31.722944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-21c0d105-a1bd-419f-9f05-22c5b2d579ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:31.723459 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-21c0d105-a1bd-419f-9f05-22c5b2d579ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:31.723905 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-21c0d105-a1bd-419f-9f05-22c5b2d579ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:31.885959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-21c0d105-a1bd-419f-9f05-22c5b2d579ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:31.894617 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-21c0d105-a1bd-419f-9f05-22c5b2d579ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.186717 Jul 28 18:11:31.895204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 507/1028] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:31 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:32.919068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e0c73ec5-cc3b-45ce-828d-e37921302464 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:32.919754 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e0c73ec5-cc3b-45ce-828d-e37921302464 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:32.926059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e0c73ec5-cc3b-45ce-828d-e37921302464 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:32.926798 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e0c73ec5-cc3b-45ce-828d-e37921302464 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:32.927591 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e0c73ec5-cc3b-45ce-828d-e37921302464 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:32.928191 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e0c73ec5-cc3b-45ce-828d-e37921302464 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:33.130966 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e0c73ec5-cc3b-45ce-828d-e37921302464 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:33.139562 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e0c73ec5-cc3b-45ce-828d-e37921302464 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.226683 Jul 28 18:11:33.140258 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 522/1029] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:32 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:34.161476 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-99938122-ecb2-4965-a42c-a1a2b16fe5ad tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:34.162093 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-99938122-ecb2-4965-a42c-a1a2b16fe5ad tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:34.169544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-99938122-ecb2-4965-a42c-a1a2b16fe5ad tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:34.169996 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-99938122-ecb2-4965-a42c-a1a2b16fe5ad tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:34.170831 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-99938122-ecb2-4965-a42c-a1a2b16fe5ad tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:34.171295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-99938122-ecb2-4965-a42c-a1a2b16fe5ad tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:34.306822 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-99938122-ecb2-4965-a42c-a1a2b16fe5ad tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:34.315104 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-99938122-ecb2-4965-a42c-a1a2b16fe5ad tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.157841 Jul 28 18:11:34.315660 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 508/1030] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:34 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:35.338255 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ec0422ed-15b7-4209-9d8b-2a184a27b459 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:35.338878 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ec0422ed-15b7-4209-9d8b-2a184a27b459 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:35.341383 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:35.342059 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=6 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:35.347017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec0422ed-15b7-4209-9d8b-2a184a27b459 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:35.347470 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec0422ed-15b7-4209-9d8b-2a184a27b459 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:35.348243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec0422ed-15b7-4209-9d8b-2a184a27b459 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:35.348683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ec0422ed-15b7-4209-9d8b-2a184a27b459 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:35.485169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ec0422ed-15b7-4209-9d8b-2a184a27b459 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:35.493141 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ec0422ed-15b7-4209-9d8b-2a184a27b459 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.159038 Jul 28 18:11:35.493703 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 523/1031] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:35 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:36.516338 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cc0ddec8-0f9e-45e9-b101-aa3db554c2eb tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:36.517066 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cc0ddec8-0f9e-45e9-b101-aa3db554c2eb tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:36.519377 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=6 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:36.524301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc0ddec8-0f9e-45e9-b101-aa3db554c2eb tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:36.524753 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc0ddec8-0f9e-45e9-b101-aa3db554c2eb tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:36.525522 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc0ddec8-0f9e-45e9-b101-aa3db554c2eb tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:36.525970 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc0ddec8-0f9e-45e9-b101-aa3db554c2eb tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:36.660488 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-cc0ddec8-0f9e-45e9-b101-aa3db554c2eb tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:36.668728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cc0ddec8-0f9e-45e9-b101-aa3db554c2eb tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.156746 Jul 28 18:11:36.669302 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 509/1032] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:36 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:36.956320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-407823a9-ccd4-40d3-a41b-bef63f89c57a req-4677ed1f-9a32-4fa4-ab7f-209e8c5e4865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49c8f7f-b382-4cbe-a1b0-3483b3d21273", "name": "network-vif-plugged", "status": "completed", "tag": "c0ced40c-6170-4e06-befd-26d27f4c9ad3"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:36.966279 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-407823a9-ccd4-40d3-a41b-bef63f89c57a req-4677ed1f-9a32-4fa4-ab7f-209e8c5e4865 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:36.966752 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-407823a9-ccd4-40d3-a41b-bef63f89c57a req-4677ed1f-9a32-4fa4-ab7f-209e8c5e4865 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:36.977791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-407823a9-ccd4-40d3-a41b-bef63f89c57a req-4677ed1f-9a32-4fa4-ab7f-209e8c5e4865 service nova] Creating event network-vif-plugged:c0ced40c-6170-4e06-befd-26d27f4c9ad3 for instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 on hv-cinder-83754 Jul 28 18:11:36.983651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-407823a9-ccd4-40d3-a41b-bef63f89c57a req-4677ed1f-9a32-4fa4-ab7f-209e8c5e4865 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030901 Jul 28 18:11:36.984293 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 524/1033] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:37.690027 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e431e764-3433-4817-bdf2-9356a94750dd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:37.690623 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e431e764-3433-4817-bdf2-9356a94750dd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:37.697385 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e431e764-3433-4817-bdf2-9356a94750dd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:37.697827 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e431e764-3433-4817-bdf2-9356a94750dd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:37.699180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e431e764-3433-4817-bdf2-9356a94750dd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:37.699789 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e431e764-3433-4817-bdf2-9356a94750dd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:37.837675 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-e431e764-3433-4817-bdf2-9356a94750dd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:37.845997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e431e764-3433-4817-bdf2-9356a94750dd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.160016 Jul 28 18:11:37.846595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 510/1034] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:37 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:38.868214 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8a7285ca-7ca5-4a09-9734-1f8ce7b7c83e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:38.868942 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8a7285ca-7ca5-4a09-9734-1f8ce7b7c83e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:38.875753 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a7285ca-7ca5-4a09-9734-1f8ce7b7c83e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:38.876137 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a7285ca-7ca5-4a09-9734-1f8ce7b7c83e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:38.876939 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a7285ca-7ca5-4a09-9734-1f8ce7b7c83e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:38.877385 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a7285ca-7ca5-4a09-9734-1f8ce7b7c83e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:39.021060 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2009636281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1518406974", "security_groups": [{"name": "tempest-secgroup-smoke-1342836541"}], "block_device_mapping_v2": [{"uuid": "4b7640bb-d335-4aea-810e-8f419dbd02b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2745d657-8db7-4817-b0a4-814cddf7a093"}]}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:39.022240 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8a7285ca-7ca5-4a09-9734-1f8ce7b7c83e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:39.030725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8a7285ca-7ca5-4a09-9734-1f8ce7b7c83e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1367 microversion: 2.1 time: 0.167011 Jul 28 18:11:39.031307 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 525/1035] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:38 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:39.136607 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.network.neutron [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] validate_networks() for [('2745d657-8db7-4817-b0a4-814cddf7a093', None, None, None, None, None)] {{(pid=130401) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:11:39.519793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Flavor limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:11:39.520217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Image limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:11:39.520711 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Flavor pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:11:39.521123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Image pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:11:39.521568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:11:39.531007 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:39.531462 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:39.532295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:39.532737 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:39.549562 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Getting quotas for project a1b1e6abd55a4b17b4a452a80a6bbdbc. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:11:39.553653 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Getting quotas for user 73edfd05da254457b6ad9c9c9f662e4c and project a1b1e6abd55a4b17b4a452a80a6bbdbc. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:11:39.612829 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Going to run 1 instances... {{(pid=130401) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:11:39.614939 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b7640bb-d335-4aea-810e-8f419dbd02b3',volume_size=None,volume_type=None)] {{(pid=130401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:11:40.016170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [3109675f-0411-435a-a443-66a4a28f3e41] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 28 18:11:40.051496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9a524ea0-4eeb-4e00-a137-1d89ac178f82 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:40.052099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9a524ea0-4eeb-4e00-a137-1d89ac178f82 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:40.059357 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9a524ea0-4eeb-4e00-a137-1d89ac178f82 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:40.059799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9a524ea0-4eeb-4e00-a137-1d89ac178f82 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:40.060561 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9a524ea0-4eeb-4e00-a137-1d89ac178f82 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:40.060997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9a524ea0-4eeb-4e00-a137-1d89ac178f82 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:40.191378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9a524ea0-4eeb-4e00-a137-1d89ac178f82 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:40.199250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9a524ea0-4eeb-4e00-a137-1d89ac178f82 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1558 microversion: 2.1 time: 0.151448 Jul 28 18:11:40.199812 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 526/1036] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:40 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:40.219776 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-69858ee3-2529-4a15-aff0-98fb83a5ffd4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:40.220265 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-69858ee3-2529-4a15-aff0-98fb83a5ffd4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:40.226370 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69858ee3-2529-4a15-aff0-98fb83a5ffd4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:40.226822 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69858ee3-2529-4a15-aff0-98fb83a5ffd4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:40.227582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69858ee3-2529-4a15-aff0-98fb83a5ffd4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:40.228016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69858ee3-2529-4a15-aff0-98fb83a5ffd4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:40.305040 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-69858ee3-2529-4a15-aff0-98fb83a5ffd4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088875 Jul 28 18:11:40.305632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 527/1037] 10.222.0.85 () {58 vars in 1275 bytes} [Thu Jul 28 18:11:40 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:11:41.025301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [3109675f-0411-435a-a443-66a4a28f3e41] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 43020. Jul 28 18:11:41.036192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-4ba603a0-cfaf-42ce-afc8-1ae0dd696d18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.018966 Jul 28 18:11:41.047405 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 511/1038] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:11:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 2031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 18:11:41.059718 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9ee47684-974a-4aae-a122-ea809f9a0470 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:41.060082 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9ee47684-974a-4aae-a122-ea809f9a0470 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:41.113841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9ee47684-974a-4aae-a122-ea809f9a0470 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:41.122611 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9ee47684-974a-4aae-a122-ea809f9a0470 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1095 microversion: 2.1 time: 0.067824 Jul 28 18:11:41.124962 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 528/1039] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:41 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:41.644766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-acecabee-f7d6-449b-89a2-bc3fca0d658e req-58025055-1f83-4b56-86a6-74eade8d31cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49c8f7f-b382-4cbe-a1b0-3483b3d21273", "tag": "c0ced40c-6170-4e06-befd-26d27f4c9ad3"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:41.656484 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-acecabee-f7d6-449b-89a2-bc3fca0d658e req-58025055-1f83-4b56-86a6-74eade8d31cd service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:41.656916 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-acecabee-f7d6-449b-89a2-bc3fca0d658e req-58025055-1f83-4b56-86a6-74eade8d31cd service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:41.668627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-acecabee-f7d6-449b-89a2-bc3fca0d658e req-58025055-1f83-4b56-86a6-74eade8d31cd service nova] Creating event network-changed:c0ced40c-6170-4e06-befd-26d27f4c9ad3 for instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 on hv-cinder-83754 Jul 28 18:11:41.673588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-acecabee-f7d6-449b-89a2-bc3fca0d658e req-58025055-1f83-4b56-86a6-74eade8d31cd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034630 Jul 28 18:11:41.674179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 512/1040] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:42.143263 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e2369049-c928-4e34-b86e-1c6501b94b86 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:42.144461 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e2369049-c928-4e34-b86e-1c6501b94b86 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:42.152651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e2369049-c928-4e34-b86e-1c6501b94b86 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:42.153109 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e2369049-c928-4e34-b86e-1c6501b94b86 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:42.153894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e2369049-c928-4e34-b86e-1c6501b94b86 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:42.154331 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e2369049-c928-4e34-b86e-1c6501b94b86 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:42.231976 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e2369049-c928-4e34-b86e-1c6501b94b86 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:42.241178 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e2369049-c928-4e34-b86e-1c6501b94b86 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1145 microversion: 2.1 time: 0.101918 Jul 28 18:11:42.242632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 529/1041] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:42 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1145 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:43.264861 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6fc3fc5a-d732-47eb-a372-c44be597cb5e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:43.266240 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6fc3fc5a-d732-47eb-a372-c44be597cb5e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:43.273515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6fc3fc5a-d732-47eb-a372-c44be597cb5e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:43.273965 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6fc3fc5a-d732-47eb-a372-c44be597cb5e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:43.274785 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6fc3fc5a-d732-47eb-a372-c44be597cb5e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:43.275233 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6fc3fc5a-d732-47eb-a372-c44be597cb5e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:43.346285 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6fc3fc5a-d732-47eb-a372-c44be597cb5e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:43.354137 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6fc3fc5a-d732-47eb-a372-c44be597cb5e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1201 microversion: 2.1 time: 0.094654 Jul 28 18:11:43.355112 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 513/1042] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:43 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:44.376071 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f1384be7-dc20-441d-b4af-593d237ca4a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:44.376750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f1384be7-dc20-441d-b4af-593d237ca4a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:44.384603 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f1384be7-dc20-441d-b4af-593d237ca4a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:44.385048 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f1384be7-dc20-441d-b4af-593d237ca4a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:44.386725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f1384be7-dc20-441d-b4af-593d237ca4a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:44.387348 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f1384be7-dc20-441d-b4af-593d237ca4a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:44.587945 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f1384be7-dc20-441d-b4af-593d237ca4a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:44.596736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f1384be7-dc20-441d-b4af-593d237ca4a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1279 microversion: 2.1 time: 0.224649 Jul 28 18:11:44.597313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 530/1043] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:44 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1279 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:45.058002 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-32abecd2-e867-4013-8036-093650932d3d req-1a42b835-5c4f-4fa9-b9cc-c14e48072651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137b3bf4-6ab6-439d-b30e-d88e6d3c0090", "tag": "68b502b1-4298-4301-80ad-a52cb8b9b62b"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:45.081271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-32abecd2-e867-4013-8036-093650932d3d req-1a42b835-5c4f-4fa9-b9cc-c14e48072651 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:45.081271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-32abecd2-e867-4013-8036-093650932d3d req-1a42b835-5c4f-4fa9-b9cc-c14e48072651 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:45.091211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-32abecd2-e867-4013-8036-093650932d3d req-1a42b835-5c4f-4fa9-b9cc-c14e48072651 service nova] Creating event network-changed:68b502b1-4298-4301-80ad-a52cb8b9b62b for instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 on hv-cinder-83754 Jul 28 18:11:45.096263 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-32abecd2-e867-4013-8036-093650932d3d req-1a42b835-5c4f-4fa9-b9cc-c14e48072651 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044209 Jul 28 18:11:45.096871 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 514/1044] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:45.620991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8e3a5b1a-dac9-4eb0-8ffb-1eba55e6f753 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:45.620991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8e3a5b1a-dac9-4eb0-8ffb-1eba55e6f753 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:45.627301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8e3a5b1a-dac9-4eb0-8ffb-1eba55e6f753 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:45.627800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8e3a5b1a-dac9-4eb0-8ffb-1eba55e6f753 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:45.628569 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8e3a5b1a-dac9-4eb0-8ffb-1eba55e6f753 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:45.629004 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8e3a5b1a-dac9-4eb0-8ffb-1eba55e6f753 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:45.836060 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8e3a5b1a-dac9-4eb0-8ffb-1eba55e6f753 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:45.844811 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8e3a5b1a-dac9-4eb0-8ffb-1eba55e6f753 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.229697 Jul 28 18:11:45.845395 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 531/1045] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:45 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:46.867112 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2a4aa6d1-a8e9-4811-8e5d-c15c963bbecb tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:46.867814 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2a4aa6d1-a8e9-4811-8e5d-c15c963bbecb tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:46.875426 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a4aa6d1-a8e9-4811-8e5d-c15c963bbecb tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:46.875878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a4aa6d1-a8e9-4811-8e5d-c15c963bbecb tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:46.876652 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a4aa6d1-a8e9-4811-8e5d-c15c963bbecb tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:46.877094 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2a4aa6d1-a8e9-4811-8e5d-c15c963bbecb tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:47.013657 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2a4aa6d1-a8e9-4811-8e5d-c15c963bbecb tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:47.021115 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2a4aa6d1-a8e9-4811-8e5d-c15c963bbecb tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.158203 Jul 28 18:11:47.026335 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 515/1046] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:46 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:48.043132 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-af9ab0ab-6060-4467-9f32-ed93a01130b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:48.043754 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-af9ab0ab-6060-4467-9f32-ed93a01130b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:48.050440 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-af9ab0ab-6060-4467-9f32-ed93a01130b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:48.050889 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-af9ab0ab-6060-4467-9f32-ed93a01130b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:48.051656 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-af9ab0ab-6060-4467-9f32-ed93a01130b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:48.052096 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-af9ab0ab-6060-4467-9f32-ed93a01130b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:48.190236 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-af9ab0ab-6060-4467-9f32-ed93a01130b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:48.198148 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-af9ab0ab-6060-4467-9f32-ed93a01130b5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.159683 Jul 28 18:11:48.198944 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 532/1047] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:48 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:49.219847 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7cac3c48-bcfc-459f-9825-295154174305 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:49.220442 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7cac3c48-bcfc-459f-9825-295154174305 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:49.227179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7cac3c48-bcfc-459f-9825-295154174305 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:49.227621 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7cac3c48-bcfc-459f-9825-295154174305 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:49.228376 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7cac3c48-bcfc-459f-9825-295154174305 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:49.228920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7cac3c48-bcfc-459f-9825-295154174305 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:49.363391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7cac3c48-bcfc-459f-9825-295154174305 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:49.371229 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7cac3c48-bcfc-459f-9825-295154174305 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.155315 Jul 28 18:11:49.371790 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 516/1048] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:49 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:50.216420 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cf9f2a83-f2a7-473e-895c-4bb32eacd9eb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:50.218833 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cf9f2a83-f2a7-473e-895c-4bb32eacd9eb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:50.225651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cf9f2a83-f2a7-473e-895c-4bb32eacd9eb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:50.226099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cf9f2a83-f2a7-473e-895c-4bb32eacd9eb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:50.226954 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cf9f2a83-f2a7-473e-895c-4bb32eacd9eb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:50.227394 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cf9f2a83-f2a7-473e-895c-4bb32eacd9eb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:50.258833 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cf9f2a83-f2a7-473e-895c-4bb32eacd9eb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047149 Jul 28 18:11:50.259416 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 533/1049] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:11:50 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 18:11:50.322998 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c7b5b372-94a1-45c7-8523-63b6da538de5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:50.323569 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c7b5b372-94a1-45c7-8523-63b6da538de5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:50.325577 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:50.326363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=6 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:50.331708 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7b5b372-94a1-45c7-8523-63b6da538de5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:50.334471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7b5b372-94a1-45c7-8523-63b6da538de5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:50.334471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7b5b372-94a1-45c7-8523-63b6da538de5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:50.334471 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c7b5b372-94a1-45c7-8523-63b6da538de5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:50.359983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c7b5b372-94a1-45c7-8523-63b6da538de5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:11:50.391939 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-251d247a-c996-450e-a090-42fbdf2bf8e3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:50.393382 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-251d247a-c996-450e-a090-42fbdf2bf8e3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:50.398809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-251d247a-c996-450e-a090-42fbdf2bf8e3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:50.399790 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-251d247a-c996-450e-a090-42fbdf2bf8e3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:50.400555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-251d247a-c996-450e-a090-42fbdf2bf8e3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:50.400997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-251d247a-c996-450e-a090-42fbdf2bf8e3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:50.704899 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-251d247a-c996-450e-a090-42fbdf2bf8e3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:50.712857 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-251d247a-c996-450e-a090-42fbdf2bf8e3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.324814 Jul 28 18:11:50.713817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 534/1050] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:50 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:50.736583 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c7b5b372-94a1-45c7-8523-63b6da538de5 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 204 len: 0 microversion: 2.1 time: 0.417165 Jul 28 18:11:50.739518 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 517/1051] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:11:50 2022] DELETE /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:11:50.746483 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ecc3b3af-f8d6-4734-84c0-53c4ae49c43c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:50.747128 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ecc3b3af-f8d6-4734-84c0-53c4ae49c43c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:50.753425 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ecc3b3af-f8d6-4734-84c0-53c4ae49c43c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:50.753876 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ecc3b3af-f8d6-4734-84c0-53c4ae49c43c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:50.754679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ecc3b3af-f8d6-4734-84c0-53c4ae49c43c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:50.755120 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ecc3b3af-f8d6-4734-84c0-53c4ae49c43c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:50.894509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ecc3b3af-f8d6-4734-84c0-53c4ae49c43c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:50.902294 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ecc3b3af-f8d6-4734-84c0-53c4ae49c43c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1672 microversion: 2.1 time: 0.159773 Jul 28 18:11:50.903000 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 535/1052] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:50 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:51.736501 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-c45ed6f7-f18d-4cc7-bc82-857e048a1acd tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:51.737230 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-c45ed6f7-f18d-4cc7-bc82-857e048a1acd tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:51.744951 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c45ed6f7-f18d-4cc7-bc82-857e048a1acd tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:51.745391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c45ed6f7-f18d-4cc7-bc82-857e048a1acd tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:51.746152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c45ed6f7-f18d-4cc7-bc82-857e048a1acd tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:51.746609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-c45ed6f7-f18d-4cc7-bc82-857e048a1acd tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:51.884634 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-c45ed6f7-f18d-4cc7-bc82-857e048a1acd tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:51.892775 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-c45ed6f7-f18d-4cc7-bc82-857e048a1acd tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.161275 Jul 28 18:11:51.893357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 518/1053] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:51 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:51.924157 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b2a7a6b6-7ecb-483a-9895-259e0d7c7388 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:51.924767 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b2a7a6b6-7ecb-483a-9895-259e0d7c7388 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:51.926742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:51.932097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b2a7a6b6-7ecb-483a-9895-259e0d7c7388 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:51.932547 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b2a7a6b6-7ecb-483a-9895-259e0d7c7388 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:51.933313 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b2a7a6b6-7ecb-483a-9895-259e0d7c7388 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:51.933750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b2a7a6b6-7ecb-483a-9895-259e0d7c7388 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:52.067833 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-b2a7a6b6-7ecb-483a-9895-259e0d7c7388 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:52.076328 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b2a7a6b6-7ecb-483a-9895-259e0d7c7388 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1672 microversion: 2.1 time: 0.155160 Jul 28 18:11:52.077308 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 536/1054] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:51 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:52.914374 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5ec1d6a7-e73b-4ce1-8ec5-6e1717c78ca8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:52.915005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5ec1d6a7-e73b-4ce1-8ec5-6e1717c78ca8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:52.922192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ec1d6a7-e73b-4ce1-8ec5-6e1717c78ca8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:52.922658 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ec1d6a7-e73b-4ce1-8ec5-6e1717c78ca8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:52.923423 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ec1d6a7-e73b-4ce1-8ec5-6e1717c78ca8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:52.923855 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ec1d6a7-e73b-4ce1-8ec5-6e1717c78ca8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:53.097803 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f425a8d4-684f-49bc-b30b-68c345031c4b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:53.098717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f425a8d4-684f-49bc-b30b-68c345031c4b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:53.105569 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f425a8d4-684f-49bc-b30b-68c345031c4b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:53.106026 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f425a8d4-684f-49bc-b30b-68c345031c4b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:53.107582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f425a8d4-684f-49bc-b30b-68c345031c4b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:53.108156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f425a8d4-684f-49bc-b30b-68c345031c4b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:53.115027 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-5ec1d6a7-e73b-4ce1-8ec5-6e1717c78ca8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:53.122659 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5ec1d6a7-e73b-4ce1-8ec5-6e1717c78ca8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.212227 Jul 28 18:11:53.123217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 519/1055] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:52 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:53.239992 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-f425a8d4-684f-49bc-b30b-68c345031c4b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:53.247559 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f425a8d4-684f-49bc-b30b-68c345031c4b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1672 microversion: 2.1 time: 0.153851 Jul 28 18:11:53.248132 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 537/1056] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:53 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:54.143454 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bc5d030c-e115-44ec-a8d0-16b35cbe2781 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:54.144008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bc5d030c-e115-44ec-a8d0-16b35cbe2781 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:54.150466 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc5d030c-e115-44ec-a8d0-16b35cbe2781 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:54.150918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc5d030c-e115-44ec-a8d0-16b35cbe2781 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:54.151686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc5d030c-e115-44ec-a8d0-16b35cbe2781 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:54.152124 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bc5d030c-e115-44ec-a8d0-16b35cbe2781 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:54.269134 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-853642d2-edad-4cc0-8d1b-fdd687735461 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:54.269740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-853642d2-edad-4cc0-8d1b-fdd687735461 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:54.276596 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-853642d2-edad-4cc0-8d1b-fdd687735461 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:54.276809 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-853642d2-edad-4cc0-8d1b-fdd687735461 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:54.277414 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-853642d2-edad-4cc0-8d1b-fdd687735461 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:54.278045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-853642d2-edad-4cc0-8d1b-fdd687735461 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:54.292591 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bc5d030c-e115-44ec-a8d0-16b35cbe2781 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:54.301745 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bc5d030c-e115-44ec-a8d0-16b35cbe2781 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.162215 Jul 28 18:11:54.302941 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 520/1057] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:54 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:54.469759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-853642d2-edad-4cc0-8d1b-fdd687735461 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:54.477859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-853642d2-edad-4cc0-8d1b-fdd687735461 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1672 microversion: 2.1 time: 0.212525 Jul 28 18:11:54.478443 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 538/1058] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:54 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1672 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:54.867521 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-8ae54975-4c2f-4edf-bd2f-d225814befd8 req-288802c6-9d65-48cc-a3a5-b2a4ab8381f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875a9106-a56f-4acb-9056-7672341ebccc", "name": "network-vif-deleted", "tag": "23f7eafd-8248-4438-9837-008bc6b5122c"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:54.878369 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-8ae54975-4c2f-4edf-bd2f-d225814befd8 req-288802c6-9d65-48cc-a3a5-b2a4ab8381f0 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:54.883000 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-8ae54975-4c2f-4edf-bd2f-d225814befd8 req-288802c6-9d65-48cc-a3a5-b2a4ab8381f0 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:54.893845 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-8ae54975-4c2f-4edf-bd2f-d225814befd8 req-288802c6-9d65-48cc-a3a5-b2a4ab8381f0 service nova] Creating event network-vif-deleted:23f7eafd-8248-4438-9837-008bc6b5122c for instance 875a9106-a56f-4acb-9056-7672341ebccc on hv-cinder-83754 Jul 28 18:11:54.899277 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-8ae54975-4c2f-4edf-bd2f-d225814befd8 req-288802c6-9d65-48cc-a3a5-b2a4ab8381f0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035502 Jul 28 18:11:54.905110 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 521/1059] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:55.324068 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-70da2ff1-0d64-406b-a11d-8f6db8f08ca3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:55.325043 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-70da2ff1-0d64-406b-a11d-8f6db8f08ca3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:55.333745 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-70da2ff1-0d64-406b-a11d-8f6db8f08ca3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:55.334202 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-70da2ff1-0d64-406b-a11d-8f6db8f08ca3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:55.334987 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-70da2ff1-0d64-406b-a11d-8f6db8f08ca3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:55.335422 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-70da2ff1-0d64-406b-a11d-8f6db8f08ca3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:55.351839 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:55.480266 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-70da2ff1-0d64-406b-a11d-8f6db8f08ca3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:55.488627 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-70da2ff1-0d64-406b-a11d-8f6db8f08ca3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.168696 Jul 28 18:11:55.489200 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 539/1060] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:55 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:55.502119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:55.503111 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:55.509326 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:55.509771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:55.510560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:55.510996 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:55.543625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:55.544657 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:55.545132 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lazy-loading 'fault' on Instance uuid 875a9106-a56f-4acb-9056-7672341ebccc {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:11:55.590257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:55.599928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8ac11341-c318-4d89-a65e-b0f48dbc360e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 200 len: 1328 microversion: 2.1 time: 0.103014 Jul 28 18:11:55.600525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 522/1061] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:55 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:11:56.510807 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ce9ea083-3e1e-4d9b-944f-040a7b975dc5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:56.511411 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ce9ea083-3e1e-4d9b-944f-040a7b975dc5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:56.518745 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce9ea083-3e1e-4d9b-944f-040a7b975dc5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:56.519207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce9ea083-3e1e-4d9b-944f-040a7b975dc5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:56.519954 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce9ea083-3e1e-4d9b-944f-040a7b975dc5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:56.520382 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ce9ea083-3e1e-4d9b-944f-040a7b975dc5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:56.621554 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:56.629176 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:56.629176 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:56.629563 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:56.630343 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:56.630809 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:56.644889 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] HTTP exception thrown: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Request method failure captured: Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc HTTP/1.1 Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tCmSSNDFVEGNwphBCRIhE0vnR_exgabJcEjiuaBuazGxHvNi9nAcxOsBDAjtyzX-f98cYm-_xyKzzGOQRLXbyz8W8k0Ri7C1SSlSO3QuOj8nYAI95oGehohO8kfwl_Pmbs-sob7was01oxYEUAmWO8W8QMTx_Edi36lt4-zZqAabU0 Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:11:56.646674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f4857a4e9170472da43e01f442099c29", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f4857a4e9170472da43e01f442099c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: f26806f1da1b4e98a867fab87249f9fe Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:11:56.648305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '875a9106-a56f-4acb-9056-7672341ebccc'} Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:11:56.649204 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:11:56.654071 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:11:56.655477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Returning 404 to user: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:11:56.655477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ed9c2c86-692c-4609-8c54-a469bfbabdef tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 404 len: 111 microversion: 2.1 time: 0.030505 Jul 28 18:11:56.655477 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 523/1062] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:56 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:11:56.658165 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-fdfa08c0-ea70-4768-b86c-4515169c21cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '.version_select at 0x7fdae033f940>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:56.660623 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ce9ea083-3e1e-4d9b-944f-040a7b975dc5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:56.668211 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ce9ea083-3e1e-4d9b-944f-040a7b975dc5 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.161305 Jul 28 18:11:56.668779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 540/1063] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:56 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:56.777325 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-fdfa08c0-ea70-4768-b86c-4515169c21cf tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123437866" status: 202 len: 0 microversion: 2.1 time: 0.123654 Jul 28 18:11:56.777823 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 524/1064] 10.222.0.85 () {58 vars in 1221 bytes} [Thu Jul 28 18:11:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1123437866 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:11:57.102196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-89f5864a-ddc8-430c-8125-9cc295086d5c req-26133f77-705a-45c9-aa99-222ab1bc297e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137b3bf4-6ab6-439d-b30e-d88e6d3c0090", "name": "network-vif-plugged", "status": "completed", "tag": "68b502b1-4298-4301-80ad-a52cb8b9b62b"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:57.117823 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-89f5864a-ddc8-430c-8125-9cc295086d5c req-26133f77-705a-45c9-aa99-222ab1bc297e service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:57.118275 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-89f5864a-ddc8-430c-8125-9cc295086d5c req-26133f77-705a-45c9-aa99-222ab1bc297e service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:57.130389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-89f5864a-ddc8-430c-8125-9cc295086d5c req-26133f77-705a-45c9-aa99-222ab1bc297e service nova] Creating event network-vif-plugged:68b502b1-4298-4301-80ad-a52cb8b9b62b for instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 on hv-cinder-83754 Jul 28 18:11:57.135383 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-89f5864a-ddc8-430c-8125-9cc295086d5c req-26133f77-705a-45c9-aa99-222ab1bc297e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037139 Jul 28 18:11:57.135972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 541/1065] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:57.661938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1b7953d4-6ecf-4591-9bdc-1f117a7a3ca2 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'create', calling method: .version_select at 0x7fdae00a1af0>, body: {"keypair": {"name": "tempest-keypair-259647570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs6f3mlH9Z2Ou5RoJRUbmr8Dp+us5q5kLBjP3Pg1QT/kUv/b5RWNUa9Kc7Y2mwuHF8lk7C1hYzjididjY12b+pNayO8b0kHQbCHEnz8ZF6Z8Yk30OfAvnwIsq7LA2ClZQ=="}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:11:57.679858 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-1b7953d4-6ecf-4591-9bdc-1f117a7a3ca2 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Getting quotas for project f4857a4e9170472da43e01f442099c29. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:11:57.685756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-1b7953d4-6ecf-4591-9bdc-1f117a7a3ca2 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Getting quotas for user f26806f1da1b4e98a867fab87249f9fe and project f4857a4e9170472da43e01f442099c29. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:11:57.696160 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-08687a1c-6460-4525-95fa-2c89c8cae167 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:57.696864 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-08687a1c-6460-4525-95fa-2c89c8cae167 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:57.704281 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-08687a1c-6460-4525-95fa-2c89c8cae167 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:57.704919 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-08687a1c-6460-4525-95fa-2c89c8cae167 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:57.713248 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-08687a1c-6460-4525-95fa-2c89c8cae167 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:57.713248 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-08687a1c-6460-4525-95fa-2c89c8cae167 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:57.800627 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1b7953d4-6ecf-4591-9bdc-1f117a7a3ca2 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143092 Jul 28 18:11:57.801266 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 525/1066] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:11:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:11:57.902466 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-08687a1c-6460-4525-95fa-2c89c8cae167 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:57.908194 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-08687a1c-6460-4525-95fa-2c89c8cae167 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.216680 Jul 28 18:11:57.908758 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 542/1067] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:57 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:11:58.929786 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3a472c17-4817-4dee-bc36-55d72d621eae tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:11:58.930434 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3a472c17-4817-4dee-bc36-55d72d621eae tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:11:58.937067 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3a472c17-4817-4dee-bc36-55d72d621eae tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:58.937517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3a472c17-4817-4dee-bc36-55d72d621eae tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:58.938290 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3a472c17-4817-4dee-bc36-55d72d621eae tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:11:58.938753 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3a472c17-4817-4dee-bc36-55d72d621eae tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:11:58.957202 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:11:59.115367 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-3a472c17-4817-4dee-bc36-55d72d621eae tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:11:59.123761 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3a472c17-4817-4dee-bc36-55d72d621eae tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1267 microversion: 2.1 time: 0.198314 Jul 28 18:11:59.124337 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 526/1068] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:11:58 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:00.145029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8ee11588-b862-4236-a5bf-0582bad32f4e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:00.145736 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8ee11588-b862-4236-a5bf-0582bad32f4e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:00.152229 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ee11588-b862-4236-a5bf-0582bad32f4e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:00.152750 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ee11588-b862-4236-a5bf-0582bad32f4e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:00.154099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ee11588-b862-4236-a5bf-0582bad32f4e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:00.154565 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ee11588-b862-4236-a5bf-0582bad32f4e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:00.236323 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1465982460", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8f74a8f-6f5e-40d7-9e04-7b25ad085712"}], "security_groups": [{"name": "tempest-securitygroup--705147435"}], "key_name": "tempest-keypair-259647570", "user_data": "}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:00.295681 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8ee11588-b862-4236-a5bf-0582bad32f4e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:00.304002 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8ee11588-b862-4236-a5bf-0582bad32f4e tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1454 microversion: 2.1 time: 0.163161 Jul 28 18:12:00.304582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 543/1069] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:00 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:00.325220 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6e46397e-acc6-46fd-9f64-41add0bd1361 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:00.325837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6e46397e-acc6-46fd-9f64-41add0bd1361 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:00.332125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6e46397e-acc6-46fd-9f64-41add0bd1361 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:00.332581 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6e46397e-acc6-46fd-9f64-41add0bd1361 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:00.333471 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6e46397e-acc6-46fd-9f64-41add0bd1361 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:00.333912 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6e46397e-acc6-46fd-9f64-41add0bd1361 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:00.345676 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.network.neutron [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] validate_networks() for [('f8f74a8f-6f5e-40d7-9e04-7b25ad085712', None, None, None, None, None)] {{(pid=130401) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:12:00.475536 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6e46397e-acc6-46fd-9f64-41add0bd1361 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:00.483947 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6e46397e-acc6-46fd-9f64-41add0bd1361 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1454 microversion: 2.1 time: 0.162708 Jul 28 18:12:00.484642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 544/1070] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:00 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1454 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:00.732709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Flavor limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:12:00.733160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Image limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:12:00.733633 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Flavor pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:12:00.734061 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Image pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:12:00.734574 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:12:00.743418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:00.743856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:00.744648 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:00.745078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:00.762062 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Getting quotas for project f4857a4e9170472da43e01f442099c29. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:00.766737 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Getting quotas for user f26806f1da1b4e98a867fab87249f9fe and project f4857a4e9170472da43e01f442099c29. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:00.778775 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Going to run 1 instances... {{(pid=130401) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:12:00.781196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:12:00.910098 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f819c32f-bd88-4d86-a7ee-2803042b111b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.678540 Jul 28 18:12:00.910992 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 527/1071] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:12:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 18:12:00.921896 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2d8d4f77-3efd-4e11-8f9b-bc9e4459adac tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:00.922545 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2d8d4f77-3efd-4e11-8f9b-bc9e4459adac tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:00.924531 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=52 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:01.039211 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2d8d4f77-3efd-4e11-8f9b-bc9e4459adac tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:01.046714 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2d8d4f77-3efd-4e11-8f9b-bc9e4459adac tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1237 microversion: 2.1 time: 0.128891 Jul 28 18:12:01.048195 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 545/1072] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:00 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:02.069574 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-adfcbaec-5121-4237-902f-3029cdcbcbeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:02.071068 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-adfcbaec-5121-4237-902f-3029cdcbcbeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:02.083002 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-adfcbaec-5121-4237-902f-3029cdcbcbeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:02.083529 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-adfcbaec-5121-4237-902f-3029cdcbcbeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:02.084299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-adfcbaec-5121-4237-902f-3029cdcbcbeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:02.084769 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-adfcbaec-5121-4237-902f-3029cdcbcbeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:02.151882 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-adfcbaec-5121-4237-902f-3029cdcbcbeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:02.160186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-adfcbaec-5121-4237-902f-3029cdcbcbeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1241 microversion: 2.1 time: 0.095310 Jul 28 18:12:02.160755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 528/1073] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:02 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:02.660636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-2e75f7f8-a32a-407a-8486-18e6eb19f1fa req-8f320821-6fe2-43b5-b540-4733f128cd42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137b3bf4-6ab6-439d-b30e-d88e6d3c0090", "tag": "68b502b1-4298-4301-80ad-a52cb8b9b62b"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:02.672935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-2e75f7f8-a32a-407a-8486-18e6eb19f1fa req-8f320821-6fe2-43b5-b540-4733f128cd42 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:02.673386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-2e75f7f8-a32a-407a-8486-18e6eb19f1fa req-8f320821-6fe2-43b5-b540-4733f128cd42 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:02.684389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-2e75f7f8-a32a-407a-8486-18e6eb19f1fa req-8f320821-6fe2-43b5-b540-4733f128cd42 service nova] Creating event network-changed:68b502b1-4298-4301-80ad-a52cb8b9b62b for instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 on hv-cinder-83754 Jul 28 18:12:02.689602 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-2e75f7f8-a32a-407a-8486-18e6eb19f1fa req-8f320821-6fe2-43b5-b540-4733f128cd42 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032745 Jul 28 18:12:02.697268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 546/1074] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:03.181691 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8b34e237-15da-45d4-8ac1-33fb9644352f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:03.183724 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8b34e237-15da-45d4-8ac1-33fb9644352f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:03.192014 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b34e237-15da-45d4-8ac1-33fb9644352f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:03.192794 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b34e237-15da-45d4-8ac1-33fb9644352f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:03.193824 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b34e237-15da-45d4-8ac1-33fb9644352f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:03.194489 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b34e237-15da-45d4-8ac1-33fb9644352f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:03.470756 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8b34e237-15da-45d4-8ac1-33fb9644352f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:03.480092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8b34e237-15da-45d4-8ac1-33fb9644352f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1297 microversion: 2.1 time: 0.302588 Jul 28 18:12:03.480678 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 529/1075] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:03 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1297 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:04.503316 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c2c9e06c-9074-460d-806f-772930ff0eeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:04.504015 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c2c9e06c-9074-460d-806f-772930ff0eeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:04.510409 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c2c9e06c-9074-460d-806f-772930ff0eeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:04.510930 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c2c9e06c-9074-460d-806f-772930ff0eeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:04.511718 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c2c9e06c-9074-460d-806f-772930ff0eeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:04.512157 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c2c9e06c-9074-460d-806f-772930ff0eeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:04.672281 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c2c9e06c-9074-460d-806f-772930ff0eeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:04.679840 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c2c9e06c-9074-460d-806f-772930ff0eeb tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1362 microversion: 2.1 time: 0.181364 Jul 28 18:12:04.680407 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 547/1076] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:04 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:05.486812 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-00e53137-0655-4aa4-a27d-0eb8aa4f9c5c req-21dd2ed0-671f-4070-9266-00bdb9d0af7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5", "tag": "3df95329-0b2b-4695-9fa1-d8563b652920"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:05.499051 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-00e53137-0655-4aa4-a27d-0eb8aa4f9c5c req-21dd2ed0-671f-4070-9266-00bdb9d0af7f service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:05.499608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-00e53137-0655-4aa4-a27d-0eb8aa4f9c5c req-21dd2ed0-671f-4070-9266-00bdb9d0af7f service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:05.515010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-00e53137-0655-4aa4-a27d-0eb8aa4f9c5c req-21dd2ed0-671f-4070-9266-00bdb9d0af7f service nova] Creating event network-changed:3df95329-0b2b-4695-9fa1-d8563b652920 for instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 on hv-cinder-83754 Jul 28 18:12:05.520648 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-00e53137-0655-4aa4-a27d-0eb8aa4f9c5c req-21dd2ed0-671f-4070-9266-00bdb9d0af7f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037528 Jul 28 18:12:05.521157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 530/1077] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:12:05.704118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1182dcc2-3b92-4ac5-bd79-a3a841157949 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:05.705270 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1182dcc2-3b92-4ac5-bd79-a3a841157949 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:05.714148 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1182dcc2-3b92-4ac5-bd79-a3a841157949 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:05.715427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1182dcc2-3b92-4ac5-bd79-a3a841157949 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:05.716800 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1182dcc2-3b92-4ac5-bd79-a3a841157949 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:05.717247 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1182dcc2-3b92-4ac5-bd79-a3a841157949 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:05.912519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1182dcc2-3b92-4ac5-bd79-a3a841157949 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:05.921191 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1182dcc2-3b92-4ac5-bd79-a3a841157949 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1362 microversion: 2.1 time: 0.223371 Jul 28 18:12:05.921837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 548/1078] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:05 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:06.942904 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-58818c10-cf0c-4305-85fa-bf12066daed3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:06.943593 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-58818c10-cf0c-4305-85fa-bf12066daed3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:06.945993 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:06.951633 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-58818c10-cf0c-4305-85fa-bf12066daed3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:06.958703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-58818c10-cf0c-4305-85fa-bf12066daed3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:06.958703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-58818c10-cf0c-4305-85fa-bf12066daed3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:06.958703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-58818c10-cf0c-4305-85fa-bf12066daed3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:07.089145 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-58818c10-cf0c-4305-85fa-bf12066daed3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:07.096664 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-58818c10-cf0c-4305-85fa-bf12066daed3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1362 microversion: 2.1 time: 0.157970 Jul 28 18:12:07.097163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 531/1079] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:06 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:08.118123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4cb7ec31-b2e7-42a1-8875-ff4681b73c49 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:08.118702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4cb7ec31-b2e7-42a1-8875-ff4681b73c49 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:08.125439 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4cb7ec31-b2e7-42a1-8875-ff4681b73c49 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:08.125877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4cb7ec31-b2e7-42a1-8875-ff4681b73c49 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:08.126662 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4cb7ec31-b2e7-42a1-8875-ff4681b73c49 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:08.127092 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4cb7ec31-b2e7-42a1-8875-ff4681b73c49 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:08.261643 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4cb7ec31-b2e7-42a1-8875-ff4681b73c49 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:08.270106 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4cb7ec31-b2e7-42a1-8875-ff4681b73c49 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1362 microversion: 2.1 time: 0.155916 Jul 28 18:12:08.270777 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 549/1080] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:08 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:09.291677 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-90346901-a4bc-4a84-be5b-62ab254230f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:09.292281 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-90346901-a4bc-4a84-be5b-62ab254230f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:09.299016 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-90346901-a4bc-4a84-be5b-62ab254230f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:09.299460 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-90346901-a4bc-4a84-be5b-62ab254230f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:09.300214 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-90346901-a4bc-4a84-be5b-62ab254230f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:09.300688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-90346901-a4bc-4a84-be5b-62ab254230f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:09.429218 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-90346901-a4bc-4a84-be5b-62ab254230f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:09.438232 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-90346901-a4bc-4a84-be5b-62ab254230f7 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1362 microversion: 2.1 time: 0.150310 Jul 28 18:12:09.438863 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 532/1081] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:09 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:10.459629 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-076e26f3-37a2-47bf-9e00-073e3bc19789 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:10.460285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-076e26f3-37a2-47bf-9e00-073e3bc19789 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:10.467038 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-076e26f3-37a2-47bf-9e00-073e3bc19789 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:10.467489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-076e26f3-37a2-47bf-9e00-073e3bc19789 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:10.468263 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-076e26f3-37a2-47bf-9e00-073e3bc19789 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:10.468698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-076e26f3-37a2-47bf-9e00-073e3bc19789 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:10.600237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-076e26f3-37a2-47bf-9e00-073e3bc19789 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:10.608978 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-076e26f3-37a2-47bf-9e00-073e3bc19789 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1362 microversion: 2.1 time: 0.153205 Jul 28 18:12:10.611570 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 550/1082] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:10 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:11.162217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-7b239a52-0933-48be-959d-5bacbf657856 req-d150cdf1-f9d1-43a4-b613-b99b49eba56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5", "name": "network-vif-plugged", "status": "completed", "tag": "3df95329-0b2b-4695-9fa1-d8563b652920"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:11.167829 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:11.169283 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=10 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:11.174721 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-7b239a52-0933-48be-959d-5bacbf657856 req-d150cdf1-f9d1-43a4-b613-b99b49eba56a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:11.175168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-7b239a52-0933-48be-959d-5bacbf657856 req-d150cdf1-f9d1-43a4-b613-b99b49eba56a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:11.186095 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-7b239a52-0933-48be-959d-5bacbf657856 req-d150cdf1-f9d1-43a4-b613-b99b49eba56a service nova] Creating event network-vif-plugged:3df95329-0b2b-4695-9fa1-d8563b652920 for instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 on hv-cinder-83754 Jul 28 18:12:11.190933 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-7b239a52-0933-48be-959d-5bacbf657856 req-d150cdf1-f9d1-43a4-b613-b99b49eba56a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032412 Jul 28 18:12:11.191532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 533/1083] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:11.632543 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-29c73267-c586-422a-bdb5-81677dc149e1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:11.633271 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-29c73267-c586-422a-bdb5-81677dc149e1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:11.635651 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:11.641742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-29c73267-c586-422a-bdb5-81677dc149e1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:11.642213 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-29c73267-c586-422a-bdb5-81677dc149e1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:11.643030 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-29c73267-c586-422a-bdb5-81677dc149e1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:11.643462 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-29c73267-c586-422a-bdb5-81677dc149e1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:11.778368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-29c73267-c586-422a-bdb5-81677dc149e1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:11.786142 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-29c73267-c586-422a-bdb5-81677dc149e1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1362 microversion: 2.1 time: 0.157676 Jul 28 18:12:11.786729 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 551/1084] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:11 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:12.809628 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a8d530b0-f754-48a0-b20f-4bdebc1ded0b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:12.810339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a8d530b0-f754-48a0-b20f-4bdebc1ded0b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:12.817230 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a8d530b0-f754-48a0-b20f-4bdebc1ded0b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:12.817643 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a8d530b0-f754-48a0-b20f-4bdebc1ded0b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:12.818437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a8d530b0-f754-48a0-b20f-4bdebc1ded0b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:12.818880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a8d530b0-f754-48a0-b20f-4bdebc1ded0b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:12.956962 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a8d530b0-f754-48a0-b20f-4bdebc1ded0b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:12.964357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a8d530b0-f754-48a0-b20f-4bdebc1ded0b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1362 microversion: 2.1 time: 0.160213 Jul 28 18:12:12.965553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 534/1085] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:12 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:13.985634 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-095c7928-3f55-4b55-9c74-6af059cb9192 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:13.986243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-095c7928-3f55-4b55-9c74-6af059cb9192 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:13.993090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-095c7928-3f55-4b55-9c74-6af059cb9192 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:13.993572 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-095c7928-3f55-4b55-9c74-6af059cb9192 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:13.994380 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-095c7928-3f55-4b55-9c74-6af059cb9192 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:13.994815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-095c7928-3f55-4b55-9c74-6af059cb9192 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:14.123169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-095c7928-3f55-4b55-9c74-6af059cb9192 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:14.130886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-095c7928-3f55-4b55-9c74-6af059cb9192 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1547 microversion: 2.1 time: 0.149033 Jul 28 18:12:14.131457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 552/1086] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:13 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:14.151504 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-35e7f580-879a-4b33-a54f-9d481bbf6f16 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:14.152060 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-35e7f580-879a-4b33-a54f-9d481bbf6f16 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:14.159546 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-35e7f580-879a-4b33-a54f-9d481bbf6f16 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:14.159990 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-35e7f580-879a-4b33-a54f-9d481bbf6f16 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:14.160749 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-35e7f580-879a-4b33-a54f-9d481bbf6f16 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:14.161177 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-35e7f580-879a-4b33-a54f-9d481bbf6f16 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:14.242860 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-35e7f580-879a-4b33-a54f-9d481bbf6f16 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095196 Jul 28 18:12:14.243497 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 535/1087] 10.222.0.85 () {58 vars in 1275 bytes} [Thu Jul 28 18:12:14 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:15.248062 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-77f90e5f-a73e-4551-bf2f-319c61c23bb0 req-e04920d0-6586-4272-b3a5-827176a23625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5", "tag": "3df95329-0b2b-4695-9fa1-d8563b652920"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:15.258564 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-77f90e5f-a73e-4551-bf2f-319c61c23bb0 req-e04920d0-6586-4272-b3a5-827176a23625 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:15.259087 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-77f90e5f-a73e-4551-bf2f-319c61c23bb0 req-e04920d0-6586-4272-b3a5-827176a23625 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:15.270773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-77f90e5f-a73e-4551-bf2f-319c61c23bb0 req-e04920d0-6586-4272-b3a5-827176a23625 service nova] Creating event network-changed:3df95329-0b2b-4695-9fa1-d8563b652920 for instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 on hv-cinder-83754 Jul 28 18:12:15.276172 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-77f90e5f-a73e-4551-bf2f-319c61c23bb0 req-e04920d0-6586-4272-b3a5-827176a23625 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031829 Jul 28 18:12:15.276949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 553/1088] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:17.856564 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-87e57ebc-aa75-4be8-8dd6-09d6be1f7aaa tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:17.857226 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-87e57ebc-aa75-4be8-8dd6-09d6be1f7aaa tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:17.863350 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-87e57ebc-aa75-4be8-8dd6-09d6be1f7aaa tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:17.863810 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-87e57ebc-aa75-4be8-8dd6-09d6be1f7aaa tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:17.864581 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-87e57ebc-aa75-4be8-8dd6-09d6be1f7aaa tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:17.865022 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-87e57ebc-aa75-4be8-8dd6-09d6be1f7aaa tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:17.890459 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-87e57ebc-aa75-4be8-8dd6-09d6be1f7aaa tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273/ips" status: 200 len: 150 microversion: 2.1 time: 0.038445 Jul 28 18:12:17.891072 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 536/1089] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:12:17 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:17.903904 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e69ba3d7-978f-49d5-8ba6-6e571d56eb71"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:17.906336 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:17.912636 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:17.913089 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:17.913870 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:17.914299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:17.998522 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Invalid volume: volume e69ba3d7-978f-49d5-8ba6-6e571d56eb71 is already attached to instances: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: POST /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273/os-volume_attachments HTTP/1.1 Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 74 Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:12:18.000044 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {"volumeAttachment": {"volumeId": "e69ba3d7-978f-49d5-8ba6-6e571d56eb71"}} Jul 28 18:12:18.001749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Invalid volume: volume e69ba3d7-978f-49d5-8ba6-6e571d56eb71 is already attached to instances: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'server_id': 'd49c8f7f-b382-4cbe-a1b0-3483b3d21273', 'body': {'volumeAttachment': {'volumeId': 'e69ba3d7-978f-49d5-8ba6-6e571d56eb71'}}} Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e69ba3d7-978f-49d5-8ba6-6e571d56eb71 is already attached to instances: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:12:18.002890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e69ba3d7-978f-49d5-8ba6-6e571d56eb71 is already attached to instances: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:18.004457 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:12:18.006025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:12:18.006025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:12:18.006025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:12:18.006025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e69ba3d7-978f-49d5-8ba6-6e571d56eb71 is already attached to instances: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b Jul 28 18:12:18.006025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:12:18.006025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 400 to user: Invalid volume: volume e69ba3d7-978f-49d5-8ba6-6e571d56eb71 is already attached to instances: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:12:18.006025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5c9efd1b-b5a7-4a87-8c5c-b8ee7c69c3ee tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102854 Jul 28 18:12:18.006025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 554/1090] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:12:17 2022] POST /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:12:18.011815 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d7658a31-089a-4539-84a6-a599daa99450 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:18.012314 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d7658a31-089a-4539-84a6-a599daa99450 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:18.018418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d7658a31-089a-4539-84a6-a599daa99450 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:18.018879 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d7658a31-089a-4539-84a6-a599daa99450 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:18.019651 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d7658a31-089a-4539-84a6-a599daa99450 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:18.020092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d7658a31-089a-4539-84a6-a599daa99450 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:18.045173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d7658a31-089a-4539-84a6-a599daa99450 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:12:18.329683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d7658a31-089a-4539-84a6-a599daa99450 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 204 len: 0 microversion: 2.1 time: 0.321399 Jul 28 18:12:18.330278 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 537/1091] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:12:18 2022] DELETE /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:12:18.338673 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-795e8997-45c7-4659-ae6e-c73e19fe9e39 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:18.340860 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-795e8997-45c7-4659-ae6e-c73e19fe9e39 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:18.347334 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-795e8997-45c7-4659-ae6e-c73e19fe9e39 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:18.348032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-795e8997-45c7-4659-ae6e-c73e19fe9e39 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:18.348788 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-795e8997-45c7-4659-ae6e-c73e19fe9e39 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:18.349214 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-795e8997-45c7-4659-ae6e-c73e19fe9e39 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:18.487332 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-795e8997-45c7-4659-ae6e-c73e19fe9e39 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:18.497379 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-795e8997-45c7-4659-ae6e-c73e19fe9e39 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1682 microversion: 2.1 time: 0.162537 Jul 28 18:12:18.498010 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 555/1092] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:18 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:19.520584 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a9029872-9156-47ab-aeed-9bca5dbf5283 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:19.521281 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-a9029872-9156-47ab-aeed-9bca5dbf5283 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:19.527533 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a9029872-9156-47ab-aeed-9bca5dbf5283 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:19.528095 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a9029872-9156-47ab-aeed-9bca5dbf5283 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:19.528874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a9029872-9156-47ab-aeed-9bca5dbf5283 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:19.529311 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-a9029872-9156-47ab-aeed-9bca5dbf5283 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:19.676422 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-a9029872-9156-47ab-aeed-9bca5dbf5283 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:19.684789 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a9029872-9156-47ab-aeed-9bca5dbf5283 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1682 microversion: 2.1 time: 0.168596 Jul 28 18:12:19.685361 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 538/1093] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:19 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:20.706735 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-516da571-5335-48a5-b357-21f180c44ae9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:20.707549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-516da571-5335-48a5-b357-21f180c44ae9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:20.714280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-516da571-5335-48a5-b357-21f180c44ae9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:20.715304 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-516da571-5335-48a5-b357-21f180c44ae9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:20.716088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-516da571-5335-48a5-b357-21f180c44ae9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:20.716633 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-516da571-5335-48a5-b357-21f180c44ae9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:20.900152 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-516da571-5335-48a5-b357-21f180c44ae9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:20.912632 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-516da571-5335-48a5-b357-21f180c44ae9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1682 microversion: 2.1 time: 0.209856 Jul 28 18:12:20.913226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 556/1094] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:20 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:21.187543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-f8eef10e-9b32-428f-a96b-656e07decb56 req-82ef0483-1aa9-44ad-8cba-9d19b986e9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49c8f7f-b382-4cbe-a1b0-3483b3d21273", "name": "network-vif-deleted", "tag": "c0ced40c-6170-4e06-befd-26d27f4c9ad3"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:21.198029 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-f8eef10e-9b32-428f-a96b-656e07decb56 req-82ef0483-1aa9-44ad-8cba-9d19b986e9c8 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:21.198580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-f8eef10e-9b32-428f-a96b-656e07decb56 req-82ef0483-1aa9-44ad-8cba-9d19b986e9c8 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:21.211729 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-f8eef10e-9b32-428f-a96b-656e07decb56 req-82ef0483-1aa9-44ad-8cba-9d19b986e9c8 service nova] Creating event network-vif-deleted:c0ced40c-6170-4e06-befd-26d27f4c9ad3 for instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 on hv-cinder-83754 Jul 28 18:12:21.218621 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-f8eef10e-9b32-428f-a96b-656e07decb56 req-82ef0483-1aa9-44ad-8cba-9d19b986e9c8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034910 Jul 28 18:12:21.219851 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 539/1095] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:21.935762 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:21.936252 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:21.943097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:21.943542 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:21.944354 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:21.944825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:21.977284 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:21.977743 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:21.978197 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lazy-loading 'fault' on Instance uuid d49c8f7f-b382-4cbe-a1b0-3483b3d21273 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:12:22.021890 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:22.029748 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-03403da5-9860-456a-aef0-94f7ae2340b1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 200 len: 1331 microversion: 2.1 time: 0.098559 Jul 28 18:12:22.030309 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 557/1096] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:21 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:23.052823 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:23.053509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:23.061478 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:23.061849 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:23.062636 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:23.063064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:23.079109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 HTTP/1.1 Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:12:23.080950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:12:23.082588 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'd49c8f7f-b382-4cbe-a1b0-3483b3d21273'} Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:12:23.083525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:12:23.084942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:23.086508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:12:23.086508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-157adbc6-3fba-462c-829d-3973aa878cc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 404 len: 111 microversion: 2.1 time: 0.034396 Jul 28 18:12:23.086508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 540/1097] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:23 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:12:23.091474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5e1fe9f3-2278-41d1-81ed-24376533d1ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '.version_select at 0x7fdae066faf0>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:23.164702 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5e1fe9f3-2278-41d1-81ed-24376533d1ce tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178383770" status: 202 len: 0 microversion: 2.1 time: 0.077101 Jul 28 18:12:23.165341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 558/1098] 10.222.0.85 () {58 vars in 1221 bytes} [Thu Jul 28 18:12:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1178383770 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:12:24.024846 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-95acadce-bf9b-41de-abcd-22d0302ebf19 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:24.025361 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-95acadce-bf9b-41de-abcd-22d0302ebf19 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:24.031641 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95acadce-bf9b-41de-abcd-22d0302ebf19 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:24.032084 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95acadce-bf9b-41de-abcd-22d0302ebf19 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:24.032842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95acadce-bf9b-41de-abcd-22d0302ebf19 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:24.033274 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-95acadce-bf9b-41de-abcd-22d0302ebf19 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:24.116467 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-95acadce-bf9b-41de-abcd-22d0302ebf19 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lazy-loading 'services' on Instance uuid 4f9e762e-5473-4949-8d19-ff0bfe5bb52b {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:12:24.322603 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-95acadce-bf9b-41de-abcd-22d0302ebf19 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments/e69ba3d7-978f-49d5-8ba6-6e571d56eb71" status: 202 len: 0 microversion: 2.1 time: 0.301476 Jul 28 18:12:24.323186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 541/1099] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:12:24 2022] DELETE /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments/e69ba3d7-978f-49d5-8ba6-6e571d56eb71 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:12:24.334342 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8ccb49a4-d207-4020-ab7e-bba86d6b6ada tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:24.337815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8ccb49a4-d207-4020-ab7e-bba86d6b6ada tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:24.347621 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ccb49a4-d207-4020-ab7e-bba86d6b6ada tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:24.347621 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ccb49a4-d207-4020-ab7e-bba86d6b6ada tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:24.347621 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ccb49a4-d207-4020-ab7e-bba86d6b6ada tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:24.348097 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8ccb49a4-d207-4020-ab7e-bba86d6b6ada tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:24.374787 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=100 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:24.380797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8ccb49a4-d207-4020-ab7e-bba86d6b6ada tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051684 Jul 28 18:12:24.381633 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 559/1100] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:12:24 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:25.395287 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b2d80ddf-4896-4866-abf1-312474c43397 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:25.397888 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b2d80ddf-4896-4866-abf1-312474c43397 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:25.404920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b2d80ddf-4896-4866-abf1-312474c43397 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:25.405360 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b2d80ddf-4896-4866-abf1-312474c43397 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:25.406160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b2d80ddf-4896-4866-abf1-312474c43397 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:25.406630 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b2d80ddf-4896-4866-abf1-312474c43397 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:25.440319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b2d80ddf-4896-4866-abf1-312474c43397 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050030 Jul 28 18:12:25.441527 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 542/1101] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:12:25 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:26.453232 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-837ddff9-34a4-4cbf-910a-0c0893853c9a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:26.455453 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-837ddff9-34a4-4cbf-910a-0c0893853c9a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:26.462826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-837ddff9-34a4-4cbf-910a-0c0893853c9a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:26.463298 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-837ddff9-34a4-4cbf-910a-0c0893853c9a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:26.464078 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-837ddff9-34a4-4cbf-910a-0c0893853c9a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:26.465083 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-837ddff9-34a4-4cbf-910a-0c0893853c9a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:26.495532 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-837ddff9-34a4-4cbf-910a-0c0893853c9a tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046935 Jul 28 18:12:26.496093 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 560/1102] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:12:26 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:12:26.560925 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3b35d390-40c7-410e-8b9f-69bbe543b5f4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:26.561618 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3b35d390-40c7-410e-8b9f-69bbe543b5f4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:26.567880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3b35d390-40c7-410e-8b9f-69bbe543b5f4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:26.568322 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3b35d390-40c7-410e-8b9f-69bbe543b5f4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:26.569079 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3b35d390-40c7-410e-8b9f-69bbe543b5f4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:26.569508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3b35d390-40c7-410e-8b9f-69bbe543b5f4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:26.595995 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3b35d390-40c7-410e-8b9f-69bbe543b5f4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:12:26.630406 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:26.906749 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3b35d390-40c7-410e-8b9f-69bbe543b5f4 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 204 len: 0 microversion: 2.1 time: 0.349879 Jul 28 18:12:26.907337 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 543/1103] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:12:26 2022] DELETE /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:12:26.915709 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-c119fb3f-b40e-4895-991c-222c7af85ad7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:26.916312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-c119fb3f-b40e-4895-991c-222c7af85ad7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:26.923394 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c119fb3f-b40e-4895-991c-222c7af85ad7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:26.923843 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c119fb3f-b40e-4895-991c-222c7af85ad7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:26.924722 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c119fb3f-b40e-4895-991c-222c7af85ad7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:26.925181 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-c119fb3f-b40e-4895-991c-222c7af85ad7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:27.061988 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-c119fb3f-b40e-4895-991c-222c7af85ad7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:27.069799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-c119fb3f-b40e-4895-991c-222c7af85ad7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1679 microversion: 2.1 time: 0.158098 Jul 28 18:12:27.070379 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 561/1104] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:26 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:28.092478 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b9717206-8ac8-44db-bc9d-e90ffa0539d7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:28.093096 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b9717206-8ac8-44db-bc9d-e90ffa0539d7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:28.100302 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b9717206-8ac8-44db-bc9d-e90ffa0539d7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:28.100752 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b9717206-8ac8-44db-bc9d-e90ffa0539d7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:28.101514 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b9717206-8ac8-44db-bc9d-e90ffa0539d7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:28.101950 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b9717206-8ac8-44db-bc9d-e90ffa0539d7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:28.239517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-b9717206-8ac8-44db-bc9d-e90ffa0539d7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:28.247304 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b9717206-8ac8-44db-bc9d-e90ffa0539d7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1679 microversion: 2.1 time: 0.159229 Jul 28 18:12:28.247871 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 544/1105] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:28 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:29.268450 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9ae04468-7246-4c22-8c0e-89b11bc55b17 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:29.269216 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9ae04468-7246-4c22-8c0e-89b11bc55b17 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:29.275973 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9ae04468-7246-4c22-8c0e-89b11bc55b17 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:29.277268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9ae04468-7246-4c22-8c0e-89b11bc55b17 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:29.277946 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9ae04468-7246-4c22-8c0e-89b11bc55b17 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:29.278391 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9ae04468-7246-4c22-8c0e-89b11bc55b17 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:29.450903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9ae04468-7246-4c22-8c0e-89b11bc55b17 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:29.458615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9ae04468-7246-4c22-8c0e-89b11bc55b17 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1679 microversion: 2.1 time: 0.194036 Jul 28 18:12:29.459189 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 562/1106] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:29 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:30.076341 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-ca2cd6db-fb4f-49fa-a007-d4aec28040e8 req-532ae487-b32e-4f5f-bd96-8a7b5043c112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f9e762e-5473-4949-8d19-ff0bfe5bb52b", "name": "network-vif-deleted", "tag": "af478c0c-b95b-48ce-bd01-5c5c161051cb"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:30.086544 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-ca2cd6db-fb4f-49fa-a007-d4aec28040e8 req-532ae487-b32e-4f5f-bd96-8a7b5043c112 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:30.089931 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-ca2cd6db-fb4f-49fa-a007-d4aec28040e8 req-532ae487-b32e-4f5f-bd96-8a7b5043c112 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:30.100000 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-ca2cd6db-fb4f-49fa-a007-d4aec28040e8 req-532ae487-b32e-4f5f-bd96-8a7b5043c112 service nova] Creating event network-vif-deleted:af478c0c-b95b-48ce-bd01-5c5c161051cb for instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b on hv-cinder-83754 Jul 28 18:12:30.105123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-ca2cd6db-fb4f-49fa-a007-d4aec28040e8 req-532ae487-b32e-4f5f-bd96-8a7b5043c112 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033032 Jul 28 18:12:30.105714 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 545/1107] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:30.482390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:30.483011 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:30.490261 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:30.490742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:30.491555 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:30.491978 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:30.527452 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:30.527889 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:30.528346 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lazy-loading 'fault' on Instance uuid 4f9e762e-5473-4949-8d19-ff0bfe5bb52b {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:12:30.578033 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:30.585772 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7071a783-f3e2-45b4-ae02-11cb6797b23e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 200 len: 1332 microversion: 2.1 time: 0.107881 Jul 28 18:12:30.586365 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 563/1108] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:30 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:31.614317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:31.614966 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:31.621927 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:31.622386 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:31.623160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:31.623589 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:31.637418 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b HTTP/1.1 Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:12:31.639241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:12:31.640852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '4f9e762e-5473-4949-8d19-ff0bfe5bb52b'} Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:12:31.642598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:12:31.644091 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:12:31.645427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:12:31.645427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b80771b7-1533-43d2-966c-9d90e06cefef tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 404 len: 111 microversion: 2.1 time: 0.031147 Jul 28 18:12:31.645427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 546/1109] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:31 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:12:31.650803 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a8a45b5c-a476-4458-9485-8e4377b21a0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '.version_select at 0x7fdae0333280>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:31.658549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:31.758014 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a8a45b5c-a476-4458-9485-8e4377b21a0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312655647" status: 202 len: 0 microversion: 2.1 time: 0.111679 Jul 28 18:12:31.758660 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 564/1110] 10.222.0.85 () {58 vars in 1221 bytes} [Thu Jul 28 18:12:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312655647 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:12:32.553705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-27b60f23-a761-483e-b7c3-7aebb6262924 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: .version_select at 0x7fdae01cd3a0>, body: {"keypair": {"name": "tempest-keypair-1395033711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRlbFtIabeVkIVcVCyusNslROdx0rIWsSaie81arGm2hENgvMLlKSW4l0fOX6tRdbPEzMSDc7WhszUqhrUVax/nR6hNMbkaucq3ca9FTUwzVDQG83Tc/2ugkuz+AX+qZA=="}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:32.571613 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-27b60f23-a761-483e-b7c3-7aebb6262924 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:32.576257 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-27b60f23-a761-483e-b7c3-7aebb6262924 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for user de20d8b31db44abf91a482d81b898755 and project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:32.662163 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-27b60f23-a761-483e-b7c3-7aebb6262924 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112336 Jul 28 18:12:32.662842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 547/1111] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:12:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:35.185533 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-539281655", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a1ed8c2-e3be-47b5-8608-0f5e33222798"}], "security_groups": [{"name": "tempest-securitygroup--1251498484"}], "key_name": "tempest-keypair-1395033711", "user_data": "}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:35.291508 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] validate_networks() for [('7a1ed8c2-e3be-47b5-8608-0f5e33222798', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:12:35.668926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:12:35.669348 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:12:35.669920 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:12:35.670328 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:12:35.670775 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:12:35.679759 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:35.680204 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:35.680999 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:35.681531 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:35.702312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:12:35.706575 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for user de20d8b31db44abf91a482d81b898755 and project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:12:35.717785 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:12:35.720112 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:12:35.857049 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b5973a46-ab93-4d1a-bafb-23187412ca8d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.676667 Jul 28 18:12:35.857693 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 565/1112] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:12:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:12:35.868954 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2bcd3053-9201-4f4d-8c39-4a861727b3a5 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:35.870281 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2bcd3053-9201-4f4d-8c39-4a861727b3a5 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:35.930980 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2bcd3053-9201-4f4d-8c39-4a861727b3a5 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:35.938730 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2bcd3053-9201-4f4d-8c39-4a861727b3a5 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1241 microversion: 2.1 time: 0.073952 Jul 28 18:12:35.939300 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 548/1113] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:35 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:36.959724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a822b9c3-0efc-4b2c-b8a8-ba6d951aab5b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:36.960329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a822b9c3-0efc-4b2c-b8a8-ba6d951aab5b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:36.967567 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a822b9c3-0efc-4b2c-b8a8-ba6d951aab5b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:36.968016 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a822b9c3-0efc-4b2c-b8a8-ba6d951aab5b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:36.968842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a822b9c3-0efc-4b2c-b8a8-ba6d951aab5b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:36.969312 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a822b9c3-0efc-4b2c-b8a8-ba6d951aab5b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:37.032243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a822b9c3-0efc-4b2c-b8a8-ba6d951aab5b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:37.039623 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a822b9c3-0efc-4b2c-b8a8-ba6d951aab5b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1245 microversion: 2.1 time: 0.084484 Jul 28 18:12:37.040180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 566/1114] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:36 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:38.064946 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-aabed74d-85eb-4d89-823f-faf0d3141f9c tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:38.065755 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-aabed74d-85eb-4d89-823f-faf0d3141f9c tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:38.068156 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:38.073052 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aabed74d-85eb-4d89-823f-faf0d3141f9c tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:38.073510 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aabed74d-85eb-4d89-823f-faf0d3141f9c tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:38.074285 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aabed74d-85eb-4d89-823f-faf0d3141f9c tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:38.074782 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aabed74d-85eb-4d89-823f-faf0d3141f9c tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:38.147324 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-aabed74d-85eb-4d89-823f-faf0d3141f9c tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:38.156260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-aabed74d-85eb-4d89-823f-faf0d3141f9c tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1311 microversion: 2.1 time: 0.095118 Jul 28 18:12:38.157055 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 549/1115] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:38 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:39.179398 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8a50bc89-dffd-4618-bb82-35d8b1db0fb9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:39.180277 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8a50bc89-dffd-4618-bb82-35d8b1db0fb9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:39.188447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a50bc89-dffd-4618-bb82-35d8b1db0fb9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:39.188903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a50bc89-dffd-4618-bb82-35d8b1db0fb9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:39.189721 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a50bc89-dffd-4618-bb82-35d8b1db0fb9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:39.190156 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a50bc89-dffd-4618-bb82-35d8b1db0fb9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:39.383114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8a50bc89-dffd-4618-bb82-35d8b1db0fb9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:39.391886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8a50bc89-dffd-4618-bb82-35d8b1db0fb9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1367 microversion: 2.1 time: 0.218038 Jul 28 18:12:39.392467 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 567/1116] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:39 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:39.919357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-53831f6a-764f-4875-bd6b-f5de2966e83e req-24cfa9da-58a3-46c4-b6be-1be2f3d93cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b", "tag": "b1793fda-8979-4046-b366-383f95e86b73"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:39.929918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-53831f6a-764f-4875-bd6b-f5de2966e83e req-24cfa9da-58a3-46c4-b6be-1be2f3d93cd3 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:39.930380 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-53831f6a-764f-4875-bd6b-f5de2966e83e req-24cfa9da-58a3-46c4-b6be-1be2f3d93cd3 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:39.942778 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-53831f6a-764f-4875-bd6b-f5de2966e83e req-24cfa9da-58a3-46c4-b6be-1be2f3d93cd3 service nova] Creating event network-changed:b1793fda-8979-4046-b366-383f95e86b73 for instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b on hv-cinder-83754 Jul 28 18:12:39.948246 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-53831f6a-764f-4875-bd6b-f5de2966e83e req-24cfa9da-58a3-46c4-b6be-1be2f3d93cd3 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108248 Jul 28 18:12:39.949543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 550/1117] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:40.414999 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-69b066a3-0805-475f-b239-6a0ca59f3c53 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:40.415606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-69b066a3-0805-475f-b239-6a0ca59f3c53 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:40.422638 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69b066a3-0805-475f-b239-6a0ca59f3c53 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:40.423083 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69b066a3-0805-475f-b239-6a0ca59f3c53 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:40.423874 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69b066a3-0805-475f-b239-6a0ca59f3c53 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:40.424299 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-69b066a3-0805-475f-b239-6a0ca59f3c53 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:40.556739 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-69b066a3-0805-475f-b239-6a0ca59f3c53 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:40.565116 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-69b066a3-0805-475f-b239-6a0ca59f3c53 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1367 microversion: 2.1 time: 0.154363 Jul 28 18:12:40.565679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 568/1118] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:40 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:41.586475 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-413fa929-398e-4de6-934d-127b4c44d005 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:41.587207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-413fa929-398e-4de6-934d-127b4c44d005 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:41.594447 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-413fa929-398e-4de6-934d-127b4c44d005 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:41.594901 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-413fa929-398e-4de6-934d-127b4c44d005 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:41.595680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-413fa929-398e-4de6-934d-127b4c44d005 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:41.596117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-413fa929-398e-4de6-934d-127b4c44d005 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:41.809946 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-413fa929-398e-4de6-934d-127b4c44d005 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:41.817709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-413fa929-398e-4de6-934d-127b4c44d005 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1367 microversion: 2.1 time: 0.236341 Jul 28 18:12:41.818290 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 551/1119] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:41 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:42.838366 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a5379551-efb9-4d09-b574-500c23279f45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:42.838974 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a5379551-efb9-4d09-b574-500c23279f45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:42.845578 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5379551-efb9-4d09-b574-500c23279f45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:42.846018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5379551-efb9-4d09-b574-500c23279f45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:42.847090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5379551-efb9-4d09-b574-500c23279f45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:42.847524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a5379551-efb9-4d09-b574-500c23279f45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:42.984248 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-a5379551-efb9-4d09-b574-500c23279f45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:42.991548 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a5379551-efb9-4d09-b574-500c23279f45 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1367 microversion: 2.1 time: 0.157143 Jul 28 18:12:42.992123 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 569/1120] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:42 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:44.014997 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0fee6e74-4dc9-4ce3-82f2-bc3b2457c0c6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:44.015558 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0fee6e74-4dc9-4ce3-82f2-bc3b2457c0c6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:44.022145 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0fee6e74-4dc9-4ce3-82f2-bc3b2457c0c6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:44.022697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0fee6e74-4dc9-4ce3-82f2-bc3b2457c0c6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:44.023496 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0fee6e74-4dc9-4ce3-82f2-bc3b2457c0c6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:44.023936 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0fee6e74-4dc9-4ce3-82f2-bc3b2457c0c6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:44.160078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0fee6e74-4dc9-4ce3-82f2-bc3b2457c0c6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:44.167728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0fee6e74-4dc9-4ce3-82f2-bc3b2457c0c6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1367 microversion: 2.1 time: 0.157563 Jul 28 18:12:44.168305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 552/1121] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:44 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:45.189315 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8a406054-41bc-4e07-8dc0-f82d6db9dc1d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:45.190043 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8a406054-41bc-4e07-8dc0-f82d6db9dc1d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:45.196711 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a406054-41bc-4e07-8dc0-f82d6db9dc1d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:45.197153 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a406054-41bc-4e07-8dc0-f82d6db9dc1d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:45.197916 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a406054-41bc-4e07-8dc0-f82d6db9dc1d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:45.198343 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a406054-41bc-4e07-8dc0-f82d6db9dc1d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:45.343205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-8a406054-41bc-4e07-8dc0-f82d6db9dc1d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:45.354279 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8a406054-41bc-4e07-8dc0-f82d6db9dc1d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1367 microversion: 2.1 time: 0.168901 Jul 28 18:12:45.355513 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 570/1122] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:45 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:45.363587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-de5a688b-867c-4735-98fd-8094f7bd0c3d req-2497d2e1-8680-42f4-bc2e-00c5851f4a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b", "name": "network-vif-plugged", "status": "completed", "tag": "b1793fda-8979-4046-b366-383f95e86b73"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:45.375339 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-de5a688b-867c-4735-98fd-8094f7bd0c3d req-2497d2e1-8680-42f4-bc2e-00c5851f4a4f service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:45.376737 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-de5a688b-867c-4735-98fd-8094f7bd0c3d req-2497d2e1-8680-42f4-bc2e-00c5851f4a4f service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:45.386813 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-de5a688b-867c-4735-98fd-8094f7bd0c3d req-2497d2e1-8680-42f4-bc2e-00c5851f4a4f service nova] Creating event network-vif-plugged:b1793fda-8979-4046-b366-383f95e86b73 for instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b on hv-cinder-83754 Jul 28 18:12:45.392622 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-de5a688b-867c-4735-98fd-8094f7bd0c3d req-2497d2e1-8680-42f4-bc2e-00c5851f4a4f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032895 Jul 28 18:12:45.393188 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 553/1123] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:12:46.373915 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:46.374737 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=6 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:46.379105 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4d28fcda-d764-4ce3-9dbc-a2adafa84405 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:46.379720 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4d28fcda-d764-4ce3-9dbc-a2adafa84405 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:46.386179 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4d28fcda-d764-4ce3-9dbc-a2adafa84405 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:46.386611 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4d28fcda-d764-4ce3-9dbc-a2adafa84405 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:46.387386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4d28fcda-d764-4ce3-9dbc-a2adafa84405 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:46.387834 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4d28fcda-d764-4ce3-9dbc-a2adafa84405 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:46.520387 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4d28fcda-d764-4ce3-9dbc-a2adafa84405 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:46.527933 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4d28fcda-d764-4ce3-9dbc-a2adafa84405 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1367 microversion: 2.1 time: 0.154923 Jul 28 18:12:46.528727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 571/1124] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:46 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:47.547207 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=6 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:12:47.551819 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f0710ec8-588a-4638-83d9-1e845e6d4c27 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:47.552603 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f0710ec8-588a-4638-83d9-1e845e6d4c27 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:47.559552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f0710ec8-588a-4638-83d9-1e845e6d4c27 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:47.560044 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f0710ec8-588a-4638-83d9-1e845e6d4c27 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:47.561077 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f0710ec8-588a-4638-83d9-1e845e6d4c27 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:47.561515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f0710ec8-588a-4638-83d9-1e845e6d4c27 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:47.699379 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f0710ec8-588a-4638-83d9-1e845e6d4c27 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:47.707133 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f0710ec8-588a-4638-83d9-1e845e6d4c27 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1367 microversion: 2.1 time: 0.161002 Jul 28 18:12:47.707703 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 554/1125] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:47 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:12:48.728538 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-41acd18d-3d74-40ec-847c-f3799a455876 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:48.729114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-41acd18d-3d74-40ec-847c-f3799a455876 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:48.736246 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-41acd18d-3d74-40ec-847c-f3799a455876 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:48.736686 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-41acd18d-3d74-40ec-847c-f3799a455876 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:48.737445 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-41acd18d-3d74-40ec-847c-f3799a455876 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:48.737872 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-41acd18d-3d74-40ec-847c-f3799a455876 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:48.866694 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-41acd18d-3d74-40ec-847c-f3799a455876 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:12:48.874742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-41acd18d-3d74-40ec-847c-f3799a455876 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1557 microversion: 2.1 time: 0.150260 Jul 28 18:12:48.875301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 572/1126] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:12:48 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:12:48.894653 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-25ec344a-e004-44d5-9ec0-a9c719e16ba2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:48.895176 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-25ec344a-e004-44d5-9ec0-a9c719e16ba2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:48.901605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-25ec344a-e004-44d5-9ec0-a9c719e16ba2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:48.902044 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-25ec344a-e004-44d5-9ec0-a9c719e16ba2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:48.902830 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-25ec344a-e004-44d5-9ec0-a9c719e16ba2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:48.903261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-25ec344a-e004-44d5-9ec0-a9c719e16ba2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:48.981049 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-25ec344a-e004-44d5-9ec0-a9c719e16ba2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090220 Jul 28 18:12:48.981638 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 555/1127] 10.222.0.85 () {58 vars in 1275 bytes} [Thu Jul 28 18:12:48 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:50.245430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-e30196b9-b543-4095-b4e8-7e0920fb49e1 req-e82f5417-d7db-4cf7-a9db-6ef1b860bb74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b", "tag": "b1793fda-8979-4046-b366-383f95e86b73"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:50.255997 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-e30196b9-b543-4095-b4e8-7e0920fb49e1 req-e82f5417-d7db-4cf7-a9db-6ef1b860bb74 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:50.256435 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-e30196b9-b543-4095-b4e8-7e0920fb49e1 req-e82f5417-d7db-4cf7-a9db-6ef1b860bb74 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:50.267841 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-e30196b9-b543-4095-b4e8-7e0920fb49e1 req-e82f5417-d7db-4cf7-a9db-6ef1b860bb74 service nova] Creating event network-changed:b1793fda-8979-4046-b366-383f95e86b73 for instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b on hv-cinder-83754 Jul 28 18:12:50.272923 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-e30196b9-b543-4095-b4e8-7e0920fb49e1 req-e82f5417-d7db-4cf7-a9db-6ef1b860bb74 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031224 Jul 28 18:12:50.273571 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 573/1128] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:51.385900 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2b27c032-da80-402a-a559-920ff3b53f54 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:12:51.386416 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2b27c032-da80-402a-a559-920ff3b53f54 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:51.393295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2b27c032-da80-402a-a559-920ff3b53f54 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.393747 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2b27c032-da80-402a-a559-920ff3b53f54 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.394555 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2b27c032-da80-402a-a559-920ff3b53f54 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:51.394996 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2b27c032-da80-402a-a559-920ff3b53f54 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:51.418158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2b27c032-da80-402a-a559-920ff3b53f54 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/ips" status: 200 len: 144 microversion: 2.1 time: 0.036859 Jul 28 18:12:51.418748 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 556/1129] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:12:51 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:12:53.109367 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b11ee7ad-17d8-4843-b939-be884f327857 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f43bede1-b0c9-4cf7-b232-9e09beb316e5"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:12:53.109367 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b11ee7ad-17d8-4843-b939-be884f327857 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:12:53.116006 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b11ee7ad-17d8-4843-b939-be884f327857 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:53.116550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b11ee7ad-17d8-4843-b939-be884f327857 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:53.117329 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b11ee7ad-17d8-4843-b939-be884f327857 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:12:53.117760 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b11ee7ad-17d8-4843-b939-be884f327857 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:12:53.897591 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b11ee7ad-17d8-4843-b939-be884f327857 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.795682 Jul 28 18:12:53.898300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 574/1130] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:12:53 2022] POST /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:01.431833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-601afaca-3610-44fd-a41d-487d04b5f02e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:01.434117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-601afaca-3610-44fd-a41d-487d04b5f02e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:01.438105 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=15 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:01.439155 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:01.444018 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-601afaca-3610-44fd-a41d-487d04b5f02e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.444473 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-601afaca-3610-44fd-a41d-487d04b5f02e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.445271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-601afaca-3610-44fd-a41d-487d04b5f02e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.446439 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-601afaca-3610-44fd-a41d-487d04b5f02e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.479762 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-601afaca-3610-44fd-a41d-487d04b5f02e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051943 Jul 28 18:13:01.480346 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 557/1131] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:13:01 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:01.493988 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-37a22a6c-6029-4963-93bc-cb82014b87b9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:01.494644 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-37a22a6c-6029-4963-93bc-cb82014b87b9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:01.503399 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-37a22a6c-6029-4963-93bc-cb82014b87b9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.503844 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-37a22a6c-6029-4963-93bc-cb82014b87b9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.504624 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-37a22a6c-6029-4963-93bc-cb82014b87b9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:01.505061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-37a22a6c-6029-4963-93bc-cb82014b87b9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:01.507768 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:01.535458 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-37a22a6c-6029-4963-93bc-cb82014b87b9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/f43bede1-b0c9-4cf7-b232-9e09beb316e5" status: 200 len: 194 microversion: 2.1 time: 0.046478 Jul 28 18:13:01.536041 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 575/1132] 10.222.0.85 () {58 vars in 1413 bytes} [Thu Jul 28 18:13:01 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/f43bede1-b0c9-4cf7-b232-9e09beb316e5 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:03.181631 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d5312eda-b14f-4df3-b261-de06a6d0e0ca tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c978ecdd-e84e-4757-a97b-201c0c3eae49"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:03.184100 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d5312eda-b14f-4df3-b261-de06a6d0e0ca tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:03.192674 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d5312eda-b14f-4df3-b261-de06a6d0e0ca tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:03.193125 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d5312eda-b14f-4df3-b261-de06a6d0e0ca tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:03.193898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d5312eda-b14f-4df3-b261-de06a6d0e0ca tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:03.194331 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d5312eda-b14f-4df3-b261-de06a6d0e0ca tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:03.937419 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d5312eda-b14f-4df3-b261-de06a6d0e0ca tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "POST /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762676 Jul 28 18:13:03.938036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 558/1133] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:13:03 2022] POST /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:12.528420 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-b895dc61-66e1-4d87-9641-0ec4fbb9ff2c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:12.530689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-b895dc61-66e1-4d87-9641-0ec4fbb9ff2c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:12.533877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:12.539017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b895dc61-66e1-4d87-9641-0ec4fbb9ff2c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.539466 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b895dc61-66e1-4d87-9641-0ec4fbb9ff2c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.540245 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b895dc61-66e1-4d87-9641-0ec4fbb9ff2c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.540734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-b895dc61-66e1-4d87-9641-0ec4fbb9ff2c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.572893 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-b895dc61-66e1-4d87-9641-0ec4fbb9ff2c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048064 Jul 28 18:13:12.573474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 576/1134] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:13:12 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:12.748820 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-449e6354-fb23-4ddc-acdf-dbcc88b6127f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:12.749407 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-449e6354-fb23-4ddc-acdf-dbcc88b6127f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:12.756427 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-449e6354-fb23-4ddc-acdf-dbcc88b6127f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.756876 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-449e6354-fb23-4ddc-acdf-dbcc88b6127f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.757648 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-449e6354-fb23-4ddc-acdf-dbcc88b6127f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.758086 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-449e6354-fb23-4ddc-acdf-dbcc88b6127f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.787977 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-449e6354-fb23-4ddc-acdf-dbcc88b6127f tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/f43bede1-b0c9-4cf7-b232-9e09beb316e5" status: 200 len: 194 microversion: 2.1 time: 0.044340 Jul 28 18:13:12.788573 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 559/1135] 10.222.0.85 () {58 vars in 1413 bytes} [Thu Jul 28 18:13:12 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/f43bede1-b0c9-4cf7-b232-9e09beb316e5 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:12.799410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a99ccfd0-77a0-4e80-91bc-d1ffd385e7c3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:12.799902 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a99ccfd0-77a0-4e80-91bc-d1ffd385e7c3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:12.807410 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a99ccfd0-77a0-4e80-91bc-d1ffd385e7c3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.807876 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a99ccfd0-77a0-4e80-91bc-d1ffd385e7c3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.808641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a99ccfd0-77a0-4e80-91bc-d1ffd385e7c3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:12.809081 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a99ccfd0-77a0-4e80-91bc-d1ffd385e7c3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:12.893026 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-a99ccfd0-77a0-4e80-91bc-d1ffd385e7c3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lazy-loading 'services' on Instance uuid bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:13:13.087791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a99ccfd0-77a0-4e80-91bc-d1ffd385e7c3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/f43bede1-b0c9-4cf7-b232-9e09beb316e5" status: 202 len: 0 microversion: 2.1 time: 0.292112 Jul 28 18:13:13.088382 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 577/1136] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:13:12 2022] DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/f43bede1-b0c9-4cf7-b232-9e09beb316e5 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:13:15.281192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-896cc023-ac8b-4ebe-97b4-c85fd5e14892 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:15.281860 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-896cc023-ac8b-4ebe-97b4-c85fd5e14892 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:15.288597 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-896cc023-ac8b-4ebe-97b4-c85fd5e14892 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.289042 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-896cc023-ac8b-4ebe-97b4-c85fd5e14892 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.289824 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-896cc023-ac8b-4ebe-97b4-c85fd5e14892 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.290261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-896cc023-ac8b-4ebe-97b4-c85fd5e14892 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.321618 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-896cc023-ac8b-4ebe-97b4-c85fd5e14892 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/c978ecdd-e84e-4757-a97b-201c0c3eae49" status: 200 len: 194 microversion: 2.1 time: 0.044863 Jul 28 18:13:15.322208 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 560/1137] 10.222.0.85 () {58 vars in 1413 bytes} [Thu Jul 28 18:13:15 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/c978ecdd-e84e-4757-a97b-201c0c3eae49 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:15.333640 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8b9e7ecb-95a8-4aef-b1ef-c38f3bb2292b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:15.334214 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8b9e7ecb-95a8-4aef-b1ef-c38f3bb2292b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:15.341415 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8b9e7ecb-95a8-4aef-b1ef-c38f3bb2292b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.341871 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8b9e7ecb-95a8-4aef-b1ef-c38f3bb2292b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.342666 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8b9e7ecb-95a8-4aef-b1ef-c38f3bb2292b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:15.343108 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8b9e7ecb-95a8-4aef-b1ef-c38f3bb2292b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:15.428442 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-8b9e7ecb-95a8-4aef-b1ef-c38f3bb2292b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lazy-loading 'services' on Instance uuid bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:13:15.698230 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8b9e7ecb-95a8-4aef-b1ef-c38f3bb2292b tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/c978ecdd-e84e-4757-a97b-201c0c3eae49" status: 202 len: 0 microversion: 2.1 time: 0.369122 Jul 28 18:13:15.699014 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 578/1138] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:13:15 2022] DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments/c978ecdd-e84e-4757-a97b-201c0c3eae49 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:13:17.929940 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-5ec8dc02-1a64-4b63-a4fb-a787872d723e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:17.932192 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-5ec8dc02-1a64-4b63-a4fb-a787872d723e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:17.939622 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ec8dc02-1a64-4b63-a4fb-a787872d723e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:17.940064 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ec8dc02-1a64-4b63-a4fb-a787872d723e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:17.940813 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ec8dc02-1a64-4b63-a4fb-a787872d723e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:17.941242 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-5ec8dc02-1a64-4b63-a4fb-a787872d723e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:17.975350 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-5ec8dc02-1a64-4b63-a4fb-a787872d723e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049212 Jul 28 18:13:17.975917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 561/1139] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:13:17 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:13:18.091051 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-11e75369-8e56-4a93-98d7-74310323d71c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:18.093330 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-11e75369-8e56-4a93-98d7-74310323d71c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:18.099931 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11e75369-8e56-4a93-98d7-74310323d71c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.100379 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11e75369-8e56-4a93-98d7-74310323d71c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.101167 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11e75369-8e56-4a93-98d7-74310323d71c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.101606 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-11e75369-8e56-4a93-98d7-74310323d71c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.130826 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-11e75369-8e56-4a93-98d7-74310323d71c tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044656 Jul 28 18:13:18.131378 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 579/1140] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:13:18 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:13:18.194686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b97684ce-2433-4038-a269-90fbaeb262fc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:18.195183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b97684ce-2433-4038-a269-90fbaeb262fc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:18.201262 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b97684ce-2433-4038-a269-90fbaeb262fc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.201705 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b97684ce-2433-4038-a269-90fbaeb262fc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.202499 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b97684ce-2433-4038-a269-90fbaeb262fc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.202935 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b97684ce-2433-4038-a269-90fbaeb262fc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.227982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b97684ce-2433-4038-a269-90fbaeb262fc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:13:18.550494 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b97684ce-2433-4038-a269-90fbaeb262fc tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 204 len: 0 microversion: 2.1 time: 0.359273 Jul 28 18:13:18.551117 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 562/1141] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:13:18 2022] DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:13:18.559734 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-490714a1-d247-480e-b9c0-9d38bfd824d8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:18.560527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-490714a1-d247-480e-b9c0-9d38bfd824d8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:18.566673 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-490714a1-d247-480e-b9c0-9d38bfd824d8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.567121 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-490714a1-d247-480e-b9c0-9d38bfd824d8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.567877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-490714a1-d247-480e-b9c0-9d38bfd824d8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:18.568314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-490714a1-d247-480e-b9c0-9d38bfd824d8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:18.707460 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-490714a1-d247-480e-b9c0-9d38bfd824d8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:18.715064 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-490714a1-d247-480e-b9c0-9d38bfd824d8 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1671 microversion: 2.1 time: 0.159489 Jul 28 18:13:18.717537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 580/1142] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:18 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:19.738687 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6666bd91-426f-4372-9ac8-e365330f5974 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:19.739406 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-6666bd91-426f-4372-9ac8-e365330f5974 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:19.745857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6666bd91-426f-4372-9ac8-e365330f5974 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.746301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6666bd91-426f-4372-9ac8-e365330f5974 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.747463 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6666bd91-426f-4372-9ac8-e365330f5974 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:19.747938 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-6666bd91-426f-4372-9ac8-e365330f5974 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:19.880290 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-6666bd91-426f-4372-9ac8-e365330f5974 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:19.887944 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6666bd91-426f-4372-9ac8-e365330f5974 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1671 microversion: 2.1 time: 0.153462 Jul 28 18:13:19.888502 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 563/1143] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:19 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:20.909341 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3512cde6-3968-471e-9626-7e757972d1c1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:20.910055 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3512cde6-3968-471e-9626-7e757972d1c1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:20.916560 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3512cde6-3968-471e-9626-7e757972d1c1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:20.917017 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3512cde6-3968-471e-9626-7e757972d1c1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:20.917757 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3512cde6-3968-471e-9626-7e757972d1c1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:20.918198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3512cde6-3968-471e-9626-7e757972d1c1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:21.362027 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3512cde6-3968-471e-9626-7e757972d1c1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:21.370144 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3512cde6-3968-471e-9626-7e757972d1c1 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1671 microversion: 2.1 time: 0.464784 Jul 28 18:13:21.370799 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 581/1144] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:20 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1671 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:21.851909 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-4dabde49-b706-4dc2-b7c5-c0de676cf71b req-fb20883d-b800-44a4-8848-a4a7dbed1160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5", "name": "network-vif-deleted", "tag": "3df95329-0b2b-4695-9fa1-d8563b652920"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:21.861840 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-4dabde49-b706-4dc2-b7c5-c0de676cf71b req-fb20883d-b800-44a4-8848-a4a7dbed1160 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:21.862398 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-4dabde49-b706-4dc2-b7c5-c0de676cf71b req-fb20883d-b800-44a4-8848-a4a7dbed1160 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:21.874315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-4dabde49-b706-4dc2-b7c5-c0de676cf71b req-fb20883d-b800-44a4-8848-a4a7dbed1160 service nova] Creating event network-vif-deleted:3df95329-0b2b-4695-9fa1-d8563b652920 for instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 on hv-cinder-83754 Jul 28 18:13:21.879335 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-4dabde49-b706-4dc2-b7c5-c0de676cf71b req-fb20883d-b800-44a4-8848-a4a7dbed1160 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032851 Jul 28 18:13:21.880676 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 564/1145] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:22.401101 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:22.401945 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:22.408895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.409350 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.410118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.410582 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.442842 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:22.443285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:22.444285 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lazy-loading 'fault' on Instance uuid bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:13:22.489237 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f26806f1da1b4e98a867fab87249f9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4857a4e9170472da43e01f442099c29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:22.497513 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-06dd4e2c-7b28-4adb-bbdb-2dd9a428942e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 200 len: 1327 microversion: 2.1 time: 0.100387 Jul 28 18:13:22.498233 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 582/1146] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:22 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:23.521181 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:23.521793 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:23.528181 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.528649 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.529422 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:23.529869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:23.543010 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] HTTP exception thrown: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Request method failure captured: Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 HTTP/1.1 Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tCmSSNDFVEGNwphBCRIhE0vnR_exgabJcEjiuaBuazGxHvNi9nAcxOsBDAjtyzX-f98cYm-_xyKzzGOQRLXbyz8W8k0Ri7C1SSlSO3QuOj8nYAI95oGehohO8kfwl_Pmbs-sob7was01oxYEUAmWO8W8QMTx_Edi36lt4-zZqAabU0 Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:23.544911 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f4857a4e9170472da43e01f442099c29", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f4857a4e9170472da43e01f442099c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: f26806f1da1b4e98a867fab87249f9fe Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:23.546663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5'} Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:23.547612 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:23.549179 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:23.550632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Returning 404 to user: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:23.550632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-3d3c6bd6-af37-4721-b21e-12f6299c812e tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 404 len: 111 microversion: 2.1 time: 0.030040 Jul 28 18:13:23.550632 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 565/1147] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:23 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:13:23.555326 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-28a822be-a211-48af-86e6-63a22f3e748d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '.version_select at 0x7fdae038c430>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:23.665579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-28a822be-a211-48af-86e6-63a22f3e748d tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-259647570" status: 202 len: 0 microversion: 2.1 time: 0.114064 Jul 28 18:13:23.666159 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 583/1148] 10.222.0.85 () {58 vars in 1218 bytes} [Thu Jul 28 18:13:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-259647570 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:13:25.078284 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-22000706-b4ef-4c6c-b038-8f5cc9497c4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:25.078906 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-22000706-b4ef-4c6c-b038-8f5cc9497c4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:25.085417 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-22000706-b4ef-4c6c-b038-8f5cc9497c4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:25.085857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-22000706-b4ef-4c6c-b038-8f5cc9497c4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:25.086647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-22000706-b4ef-4c6c-b038-8f5cc9497c4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:25.087109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-22000706-b4ef-4c6c-b038-8f5cc9497c4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:25.114883 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-22000706-b4ef-4c6c-b038-8f5cc9497c4b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/ips" status: 200 len: 149 microversion: 2.1 time: 0.040717 Jul 28 18:13:25.115468 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 566/1149] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:13:25 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:26.862075 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-34332a16-b49a-4b86-ae56-f9e5dce8bfc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c69b4fe6-e286-42dc-8a7e-e753d52fa9b6"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:26.864497 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-34332a16-b49a-4b86-ae56-f9e5dce8bfc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:26.871527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-34332a16-b49a-4b86-ae56-f9e5dce8bfc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:26.871977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-34332a16-b49a-4b86-ae56-f9e5dce8bfc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:26.872958 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-34332a16-b49a-4b86-ae56-f9e5dce8bfc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:26.873477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-34332a16-b49a-4b86-ae56-f9e5dce8bfc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.009941 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:27.010856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:27.017869 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.018319 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.019306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.019795 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.034733 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] HTTP exception thrown: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Request method failure captured: Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 HTTP/1.1 Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tCmSSNDFVEGNwphBCRIhE0vnR_exgabJcEjiuaBuazGxHvNi9nAcxOsBDAjtyzX-f98cYm-_xyKzzGOQRLXbyz8W8k0Ri7C1SSlSO3QuOj8nYAI95oGehohO8kfwl_Pmbs-sob7was01oxYEUAmWO8W8QMTx_Edi36lt4-zZqAabU0 Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:27.036092 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f4857a4e9170472da43e01f442099c29", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f4857a4e9170472da43e01f442099c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: f26806f1da1b4e98a867fab87249f9fe Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.037842 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5'} Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:27.038669 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.039969 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.041231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Returning 404 to user: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:27.041231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cea87857-3ab8-4cdb-bdb6-d7708d9b1ae3 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 404 len: 111 microversion: 2.1 time: 0.031507 Jul 28 18:13:27.041231 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 567/1150] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:13:27 2022] DELETE /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:13:27.046509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:27.047143 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:27.053304 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.053688 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.054482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:27.054924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:27.070327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] HTTP exception thrown: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Request method failure captured: Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 HTTP/1.1 Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tCmSSNDFVEGNwphBCRIhE0vnR_exgabJcEjiuaBuazGxHvNi9nAcxOsBDAjtyzX-f98cYm-_xyKzzGOQRLXbyz8W8k0Ri7C1SSlSO3QuOj8nYAI95oGehohO8kfwl_Pmbs-sob7was01oxYEUAmWO8W8QMTx_Edi36lt4-zZqAabU0 Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:27.071932 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f4857a4e9170472da43e01f442099c29", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f4857a4e9170472da43e01f442099c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: f26806f1da1b4e98a867fab87249f9fe Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.073746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5'} Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:27.075394 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. Jul 28 18:13:27.076920 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:27.078410 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Returning 404 to user: Instance bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:27.078410 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2174988d-c813-4ae3-b313-334aec77c941 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5" status: 404 len: 111 microversion: 2.1 time: 0.030987 Jul 28 18:13:27.078410 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 568/1151] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:27 2022] GET /compute/v2.1/servers/bb0a5070-3c1c-4a4b-b3fa-bc92a6d8c1d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:13:27.766168 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-34332a16-b49a-4b86-ae56-f9e5dce8bfc1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908385 Jul 28 18:13:27.766868 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 584/1152] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:13:26 2022] POST /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:28.400301 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:28.400814 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:28.407968 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:28.408407 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:28.409160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:28.409586 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:28.422711 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] HTTP exception thrown: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Request method failure captured: Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc HTTP/1.1 Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tCmSSNDFVEGNwphBCRIhE0vnR_exgabJcEjiuaBuazGxHvNi9nAcxOsBDAjtyzX-f98cYm-_xyKzzGOQRLXbyz8W8k0Ri7C1SSlSO3QuOj8nYAI95oGehohO8kfwl_Pmbs-sob7was01oxYEUAmWO8W8QMTx_Edi36lt4-zZqAabU0 Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:28.424329 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f4857a4e9170472da43e01f442099c29", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f4857a4e9170472da43e01f442099c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: f26806f1da1b4e98a867fab87249f9fe Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.426332 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '875a9106-a56f-4acb-9056-7672341ebccc'} Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:28.427288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.428543 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.429959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Returning 404 to user: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:28.429959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-892fe7e4-994b-4eb6-b259-9b6241a007a9 tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "DELETE /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 404 len: 111 microversion: 2.1 time: 0.029223 Jul 28 18:13:28.429959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 569/1153] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:13:28 2022] DELETE /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:13:28.436265 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:28.436969 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] [instance: 875a9106-a56f-4acb-9056-7672341ebccc] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:28.444306 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:28.452877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:28.452877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:28.452877 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:28.460350 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] HTTP exception thrown: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Request method failure captured: Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc HTTP/1.1 Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4tCmSSNDFVEGNwphBCRIhE0vnR_exgabJcEjiuaBuazGxHvNi9nAcxOsBDAjtyzX-f98cYm-_xyKzzGOQRLXbyz8W8k0Ri7C1SSlSO3QuOj8nYAI95oGehohO8kfwl_Pmbs-sob7was01oxYEUAmWO8W8QMTx_Edi36lt4-zZqAabU0 Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:13:28.462032 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_f4857a4e9170472da43e01f442099c29", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/f4857a4e9170472da43e01f442099c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/f4857a4e9170472da43e01f442099c29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: f4857a4e9170472da43e01f442099c29 Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1686443540 Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: f26806f1da1b4e98a867fab87249f9fe Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeTestJSON-1686443540-project Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.463647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '875a9106-a56f-4acb-9056-7672341ebccc'} Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:28.464477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. Jul 28 18:13:28.467207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:28.469243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] Returning 404 to user: Instance 875a9106-a56f-4acb-9056-7672341ebccc could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:28.469243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-bae84121-544f-45c0-a533-8ebf044fcc9a tempest-AttachVolumeTestJSON-1686443540 tempest-AttachVolumeTestJSON-1686443540-project] 10.222.0.85 "GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc" status: 404 len: 111 microversion: 2.1 time: 0.031905 Jul 28 18:13:28.469243 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 585/1154] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:28 2022] GET /compute/v2.1/servers/875a9106-a56f-4acb-9056-7672341ebccc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:13:32.377315 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-b46a3d04-6fd0-4533-98f2-698ee279566b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:32.377927 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b46a3d04-6fd0-4533-98f2-698ee279566b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:32.380631 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:32.386043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b46a3d04-6fd0-4533-98f2-698ee279566b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.386605 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b46a3d04-6fd0-4533-98f2-698ee279566b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.387482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b46a3d04-6fd0-4533-98f2-698ee279566b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.387983 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-b46a3d04-6fd0-4533-98f2-698ee279566b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.414974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-b46a3d04-6fd0-4533-98f2-698ee279566b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:13:32.448993 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-98aac2e4-f47c-4f44-87de-0dc0e6a8f870 req-1ad6927c-3d3c-43ed-9ae2-db636aecb2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "137b3bf4-6ab6-439d-b30e-d88e6d3c0090", "tag": "68b502b1-4298-4301-80ad-a52cb8b9b62b"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:32.465205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-98aac2e4-f47c-4f44-87de-0dc0e6a8f870 req-1ad6927c-3d3c-43ed-9ae2-db636aecb2b2 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.465205 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-98aac2e4-f47c-4f44-87de-0dc0e6a8f870 req-1ad6927c-3d3c-43ed-9ae2-db636aecb2b2 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.478785 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-98aac2e4-f47c-4f44-87de-0dc0e6a8f870 req-1ad6927c-3d3c-43ed-9ae2-db636aecb2b2 service nova] Creating event network-changed:68b502b1-4298-4301-80ad-a52cb8b9b62b for instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 on hv-cinder-83754 Jul 28 18:13:32.489281 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-98aac2e4-f47c-4f44-87de-0dc0e6a8f870 req-1ad6927c-3d3c-43ed-9ae2-db636aecb2b2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109982 Jul 28 18:13:32.491717 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 586/1155] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:13:32.761213 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-b46a3d04-6fd0-4533-98f2-698ee279566b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "DELETE /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 204 len: 0 microversion: 2.1 time: 0.387797 Jul 28 18:13:32.762542 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 570/1156] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:13:32 2022] DELETE /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:13:32.775903 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-71b9ec9c-6d3c-42d2-9e32-cae2c2e38e7d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:32.776631 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-71b9ec9c-6d3c-42d2-9e32-cae2c2e38e7d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:32.783408 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-71b9ec9c-6d3c-42d2-9e32-cae2c2e38e7d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.783863 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-71b9ec9c-6d3c-42d2-9e32-cae2c2e38e7d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.784645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-71b9ec9c-6d3c-42d2-9e32-cae2c2e38e7d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:32.785081 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-71b9ec9c-6d3c-42d2-9e32-cae2c2e38e7d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:32.935647 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-71b9ec9c-6d3c-42d2-9e32-cae2c2e38e7d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:32.944294 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-71b9ec9c-6d3c-42d2-9e32-cae2c2e38e7d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1579 microversion: 2.1 time: 0.172627 Jul 28 18:13:32.945465 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 587/1157] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:32 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1579 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:33.967915 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d4ef0abe-d3d8-429a-8f4f-6d649b0a09fe tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:33.968607 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d4ef0abe-d3d8-429a-8f4f-6d649b0a09fe tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:33.976311 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d4ef0abe-d3d8-429a-8f4f-6d649b0a09fe tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.976758 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d4ef0abe-d3d8-429a-8f4f-6d649b0a09fe tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.977520 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d4ef0abe-d3d8-429a-8f4f-6d649b0a09fe tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:33.977956 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d4ef0abe-d3d8-429a-8f4f-6d649b0a09fe tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:33.983245 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:34.126862 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d4ef0abe-d3d8-429a-8f4f-6d649b0a09fe tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:34.135344 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d4ef0abe-d3d8-429a-8f4f-6d649b0a09fe tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1579 microversion: 2.1 time: 0.172077 Jul 28 18:13:34.136016 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 571/1158] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:33 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:35.157685 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2c1b7e16-ac89-4988-b497-f3aad9cd9815 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:35.158521 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2c1b7e16-ac89-4988-b497-f3aad9cd9815 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:35.166472 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2c1b7e16-ac89-4988-b497-f3aad9cd9815 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.167014 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2c1b7e16-ac89-4988-b497-f3aad9cd9815 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.168614 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2c1b7e16-ac89-4988-b497-f3aad9cd9815 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.169353 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2c1b7e16-ac89-4988-b497-f3aad9cd9815 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.386027 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2c1b7e16-ac89-4988-b497-f3aad9cd9815 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:35.394762 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2c1b7e16-ac89-4988-b497-f3aad9cd9815 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1460 microversion: 2.1 time: 0.241120 Jul 28 18:13:35.395876 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 588/1159] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:35 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1460 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:35.441836 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c69b4fe6-e286-42dc-8a7e-e753d52fa9b6"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:35.444272 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:35.451844 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.452265 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.453017 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.453450 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.555952 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Invalid volume: volume c69b4fe6-e286-42dc-8a7e-e753d52fa9b6 is already attached to instances: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: POST /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments HTTP/1.1 Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 74 Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:35.559241 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {"volumeAttachment": {"volumeId": "c69b4fe6-e286-42dc-8a7e-e753d52fa9b6"}} Jul 28 18:13:35.560644 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Invalid volume: volume c69b4fe6-e286-42dc-8a7e-e753d52fa9b6 is already attached to instances: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'server_id': 'e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b', 'body': {'volumeAttachment': {'volumeId': 'c69b4fe6-e286-42dc-8a7e-e753d52fa9b6'}}} Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c69b4fe6-e286-42dc-8a7e-e753d52fa9b6 is already attached to instances: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:35.561556 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c69b4fe6-e286-42dc-8a7e-e753d52fa9b6 is already attached to instances: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:35.562912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:35.564162 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:35.564162 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:35.564162 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:35.564162 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c69b4fe6-e286-42dc-8a7e-e753d52fa9b6 is already attached to instances: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b Jul 28 18:13:35.564162 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:35.566492 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-34fee91c-e0d0-4976-bcb7-54fae3b96ee2 req-73417862-7fd2-4e2c-88dc-3d439da072bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "137b3bf4-6ab6-439d-b30e-d88e6d3c0090", "name": "network-vif-deleted", "tag": "68b502b1-4298-4301-80ad-a52cb8b9b62b"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:35.567072 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 400 to user: Invalid volume: volume c69b4fe6-e286-42dc-8a7e-e753d52fa9b6 is already attached to instances: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:35.567653 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-66c2b7e1-36a8-4d97-8054-af1b77dbd354 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129903 Jul 28 18:13:35.568530 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 572/1160] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:13:35 2022] POST /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 18:13:35.581250 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-34fee91c-e0d0-4976-bcb7-54fae3b96ee2 req-73417862-7fd2-4e2c-88dc-3d439da072bc service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.584225 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-34fee91c-e0d0-4976-bcb7-54fae3b96ee2 req-73417862-7fd2-4e2c-88dc-3d439da072bc service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.595985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-34fee91c-e0d0-4976-bcb7-54fae3b96ee2 req-73417862-7fd2-4e2c-88dc-3d439da072bc service nova] Creating event network-vif-deleted:68b502b1-4298-4301-80ad-a52cb8b9b62b for instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 on hv-cinder-83754 Jul 28 18:13:35.601289 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-34fee91c-e0d0-4976-bcb7-54fae3b96ee2 req-73417862-7fd2-4e2c-88dc-3d439da072bc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038378 Jul 28 18:13:35.601880 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 589/1161] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:13:35.637874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-337fb08c-b5ba-4cf1-b04f-5a2c01ce07d8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:35.639288 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-337fb08c-b5ba-4cf1-b04f-5a2c01ce07d8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:35.648846 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-337fb08c-b5ba-4cf1-b04f-5a2c01ce07d8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.649210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-337fb08c-b5ba-4cf1-b04f-5a2c01ce07d8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.649977 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-337fb08c-b5ba-4cf1-b04f-5a2c01ce07d8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:35.650437 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-337fb08c-b5ba-4cf1-b04f-5a2c01ce07d8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:35.738242 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-337fb08c-b5ba-4cf1-b04f-5a2c01ce07d8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lazy-loading 'services' on Instance uuid e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:13:36.040953 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-337fb08c-b5ba-4cf1-b04f-5a2c01ce07d8 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments/c69b4fe6-e286-42dc-8a7e-e753d52fa9b6" status: 202 len: 0 microversion: 2.1 time: 0.406921 Jul 28 18:13:36.043999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 573/1162] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:13:35 2022] DELETE /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments/c69b4fe6-e286-42dc-8a7e-e753d52fa9b6 => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:13:36.054993 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-65fe544c-2925-45a2-bc18-8ed35f4aebc7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:36.059351 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-65fe544c-2925-45a2-bc18-8ed35f4aebc7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:36.068103 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-65fe544c-2925-45a2-bc18-8ed35f4aebc7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.068561 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-65fe544c-2925-45a2-bc18-8ed35f4aebc7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.069350 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-65fe544c-2925-45a2-bc18-8ed35f4aebc7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.069774 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-65fe544c-2925-45a2-bc18-8ed35f4aebc7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.112209 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-65fe544c-2925-45a2-bc18-8ed35f4aebc7 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065163 Jul 28 18:13:36.112793 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 590/1163] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:13:36 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 18:13:36.417300 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:36.418504 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:36.424715 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.425158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.425926 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.426368 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.459265 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:36.459921 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:36.460047 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lazy-loading 'fault' on Instance uuid 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:13:36.503608 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:36.511054 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-837d6182-6674-40c4-9e57-6ebe7fbd88a8 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 200 len: 1231 microversion: 2.1 time: 0.098087 Jul 28 18:13:36.512183 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 574/1164] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:36 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:37.129202 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-a15b0d81-3fe7-437f-8c8c-c63111083f0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:37.131447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-a15b0d81-3fe7-437f-8c8c-c63111083f0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:37.138859 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a15b0d81-3fe7-437f-8c8c-c63111083f0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.139194 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a15b0d81-3fe7-437f-8c8c-c63111083f0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.139972 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a15b0d81-3fe7-437f-8c8c-c63111083f0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.140416 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-a15b0d81-3fe7-437f-8c8c-c63111083f0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.169081 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:37.176188 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-a15b0d81-3fe7-437f-8c8c-c63111083f0f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050977 Jul 28 18:13:37.176945 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 591/1165] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:13:37 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:37.534626 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:37.535240 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 137b3bf4-6ab6-439d-b30e-d88e6d3c0090] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:37.542193 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.542840 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.543647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:37.544085 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:37.557878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] HTTP exception thrown: Instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 could not be found. Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Request method failure captured: Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 HTTP/1.1 Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s_AXY_VHHcQahsxAU5bJ_e-A0sMj1nvn58EMe-BEXKOAUFRRxtXJImp79cmOZMhi4ncJ4oEFCRueyM5r84ougYMgq4s5MY5FJb4WXpn8R8ozOiiccb-OGRTQ4h7Qjb34RY7_7p0hnqOkp_mnqPyt72qxKKQV8winW6KuSZu2pFkNKw Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:37.559787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a1b1e6abd55a4b17b4a452a80a6bbdbc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 73edfd05da254457b6ad9c9c9f662e4c Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 could not be found. Jul 28 18:13:37.565880 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '137b3bf4-6ab6-439d-b30e-d88e6d3c0090'} Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 could not be found. Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:37.566738 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 could not be found. Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 could not be found. Jul 28 18:13:37.567979 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:37.569874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Returning 404 to user: Instance 137b3bf4-6ab6-439d-b30e-d88e6d3c0090 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:37.569874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-421de505-c7d3-4941-bf69-0bdf5f6b0e29 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090" status: 404 len: 111 microversion: 2.1 time: 0.030732 Jul 28 18:13:37.569874 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 575/1166] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:37 2022] GET /compute/v2.1/servers/137b3bf4-6ab6-439d-b30e-d88e6d3c0090 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:13:38.190263 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-71a4e9db-6804-4ea6-bd0d-d0d40b9247db tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:38.192478 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-71a4e9db-6804-4ea6-bd0d-d0d40b9247db tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:38.200331 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-71a4e9db-6804-4ea6-bd0d-d0d40b9247db tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.200784 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-71a4e9db-6804-4ea6-bd0d-d0d40b9247db tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.202725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-71a4e9db-6804-4ea6-bd0d-d0d40b9247db tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.202725 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-71a4e9db-6804-4ea6-bd0d-d0d40b9247db tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.232300 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-71a4e9db-6804-4ea6-bd0d-d0d40b9247db tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046413 Jul 28 18:13:38.232894 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 592/1167] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:13:38 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 18:13:38.299767 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1c28ffe3-c6c2-4a86-b0a2-09a60e7d1045 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:38.300256 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1c28ffe3-c6c2-4a86-b0a2-09a60e7d1045 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:38.306670 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1c28ffe3-c6c2-4a86-b0a2-09a60e7d1045 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.307118 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1c28ffe3-c6c2-4a86-b0a2-09a60e7d1045 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.308700 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1c28ffe3-c6c2-4a86-b0a2-09a60e7d1045 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.309284 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1c28ffe3-c6c2-4a86-b0a2-09a60e7d1045 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.335295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1c28ffe3-c6c2-4a86-b0a2-09a60e7d1045 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:13:38.766987 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1c28ffe3-c6c2-4a86-b0a2-09a60e7d1045 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 204 len: 0 microversion: 2.1 time: 0.470786 Jul 28 18:13:38.767584 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 576/1168] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:13:38 2022] DELETE /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:13:38.775907 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-e341c4f9-edd6-4b5c-981c-a9d7db189750 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:38.776519 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-e341c4f9-edd6-4b5c-981c-a9d7db189750 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:38.784357 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e341c4f9-edd6-4b5c-981c-a9d7db189750 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.784808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e341c4f9-edd6-4b5c-981c-a9d7db189750 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.785576 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e341c4f9-edd6-4b5c-981c-a9d7db189750 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:38.786009 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-e341c4f9-edd6-4b5c-981c-a9d7db189750 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:38.930407 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-e341c4f9-edd6-4b5c-981c-a9d7db189750 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:38.939358 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-e341c4f9-edd6-4b5c-981c-a9d7db189750 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1681 microversion: 2.1 time: 0.167386 Jul 28 18:13:38.939960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 593/1169] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:38 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:39.962078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-bf9823d5-f478-499a-9dfa-c247cb4075fd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:39.962801 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-bf9823d5-f478-499a-9dfa-c247cb4075fd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:39.970224 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf9823d5-f478-499a-9dfa-c247cb4075fd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.970707 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf9823d5-f478-499a-9dfa-c247cb4075fd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:39.971463 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf9823d5-f478-499a-9dfa-c247cb4075fd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:39.971898 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-bf9823d5-f478-499a-9dfa-c247cb4075fd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:40.111185 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-bf9823d5-f478-499a-9dfa-c247cb4075fd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:40.118999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-bf9823d5-f478-499a-9dfa-c247cb4075fd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1681 microversion: 2.1 time: 0.161185 Jul 28 18:13:40.119574 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 577/1170] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:39 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:41.141239 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-9981bcfd-a3ae-4be6-8151-6905847159cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:41.141828 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-9981bcfd-a3ae-4be6-8151-6905847159cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:41.148473 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9981bcfd-a3ae-4be6-8151-6905847159cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.148920 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9981bcfd-a3ae-4be6-8151-6905847159cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.149683 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9981bcfd-a3ae-4be6-8151-6905847159cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.150114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-9981bcfd-a3ae-4be6-8151-6905847159cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.431090 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-cc5cb2b9-d36c-46b0-97a0-c2d0c8d096a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:41.431696 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cc5cb2b9-d36c-46b0-97a0-c2d0c8d096a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:41.439907 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc5cb2b9-d36c-46b0-97a0-c2d0c8d096a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.441220 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc5cb2b9-d36c-46b0-97a0-c2d0c8d096a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.441395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc5cb2b9-d36c-46b0-97a0-c2d0c8d096a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.441928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-cc5cb2b9-d36c-46b0-97a0-c2d0c8d096a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.461216 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-9981bcfd-a3ae-4be6-8151-6905847159cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:41.472312 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-cc5cb2b9-d36c-46b0-97a0-c2d0c8d096a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Going to try to terminate instance {{(pid=130401) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:13:41.472732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-9981bcfd-a3ae-4be6-8151-6905847159cd tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1681 microversion: 2.1 time: 0.335357 Jul 28 18:13:41.473333 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 594/1171] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:41 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1681 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:41.490764 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-65fe4436-dfe2-48b7-8b24-30c1fdd8f76e req-6f7cad05-6b7f-4494-abe9-40c2846d151c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee5c512-be6b-4ace-a719-1111bf9781be", "tag": "865b74cb-5e80-4ef5-a157-9e8ba6c62279"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:41.500703 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-65fe4436-dfe2-48b7-8b24-30c1fdd8f76e req-6f7cad05-6b7f-4494-abe9-40c2846d151c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.501383 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-65fe4436-dfe2-48b7-8b24-30c1fdd8f76e req-6f7cad05-6b7f-4494-abe9-40c2846d151c service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.515628 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-65fe4436-dfe2-48b7-8b24-30c1fdd8f76e req-6f7cad05-6b7f-4494-abe9-40c2846d151c service nova] Creating event network-changed:865b74cb-5e80-4ef5-a157-9e8ba6c62279 for instance 3ee5c512-be6b-4ace-a719-1111bf9781be on hv-cinder-83754 Jul 28 18:13:41.521783 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-65fe4436-dfe2-48b7-8b24-30c1fdd8f76e req-6f7cad05-6b7f-4494-abe9-40c2846d151c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047212 Jul 28 18:13:41.522689 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 595/1172] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:41.892411 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-cc5cb2b9-d36c-46b0-97a0-c2d0c8d096a3 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 204 len: 0 microversion: 2.1 time: 0.465574 Jul 28 18:13:41.893174 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 578/1173] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:13:41 2022] DELETE /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 18:13:41.902177 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5e84e4e5-69b4-4d7b-925d-442840007895 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:41.903004 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5e84e4e5-69b4-4d7b-925d-442840007895 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:41.909513 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5e84e4e5-69b4-4d7b-925d-442840007895 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.910046 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5e84e4e5-69b4-4d7b-925d-442840007895 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:41.911056 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5e84e4e5-69b4-4d7b-925d-442840007895 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:41.911664 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5e84e4e5-69b4-4d7b-925d-442840007895 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.496580 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1e3ac060-bb48-4308-804a-dfc5f81c6ca1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:42.497410 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1e3ac060-bb48-4308-804a-dfc5f81c6ca1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:42.499213 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5e84e4e5-69b4-4d7b-925d-442840007895 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:42.510039 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5e84e4e5-69b4-4d7b-925d-442840007895 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1577 microversion: 2.1 time: 0.612582 Jul 28 18:13:42.510724 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 596/1174] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:41 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1577 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:42.513913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1e3ac060-bb48-4308-804a-dfc5f81c6ca1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.514464 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1e3ac060-bb48-4308-804a-dfc5f81c6ca1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.515249 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1e3ac060-bb48-4308-804a-dfc5f81c6ca1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:42.515982 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1e3ac060-bb48-4308-804a-dfc5f81c6ca1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:42.595097 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-1e3ac060-bb48-4308-804a-dfc5f81c6ca1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:42.603147 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1e3ac060-bb48-4308-804a-dfc5f81c6ca1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1613 microversion: 2.1 time: 0.111375 Jul 28 18:13:42.606607 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 579/1175] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:42 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:43.533991 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2ece9821-992b-4153-bbc8-734e1c49f205 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:43.534732 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2ece9821-992b-4153-bbc8-734e1c49f205 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:43.537516 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:43.542666 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ece9821-992b-4153-bbc8-734e1c49f205 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.543127 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ece9821-992b-4153-bbc8-734e1c49f205 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.543933 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ece9821-992b-4153-bbc8-734e1c49f205 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.544553 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2ece9821-992b-4153-bbc8-734e1c49f205 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.545667 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-41ecd3ca-5562-4d35-8a2c-e7ece6373023 req-c13fd2c8-5a42-4aeb-ae91-95746e0ae4ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b", "name": "network-vif-deleted", "tag": "b1793fda-8979-4046-b366-383f95e86b73"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:43.558571 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-41ecd3ca-5562-4d35-8a2c-e7ece6373023 req-c13fd2c8-5a42-4aeb-ae91-95746e0ae4ca service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.559165 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-41ecd3ca-5562-4d35-8a2c-e7ece6373023 req-c13fd2c8-5a42-4aeb-ae91-95746e0ae4ca service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.570977 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-41ecd3ca-5562-4d35-8a2c-e7ece6373023 req-c13fd2c8-5a42-4aeb-ae91-95746e0ae4ca service nova] Creating event network-vif-deleted:b1793fda-8979-4046-b366-383f95e86b73 for instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b on hv-cinder-83754 Jul 28 18:13:43.576971 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-41ecd3ca-5562-4d35-8a2c-e7ece6373023 req-c13fd2c8-5a42-4aeb-ae91-95746e0ae4ca service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035503 Jul 28 18:13:43.577650 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 580/1176] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:43.625918 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:43.626841 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:43.634546 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.635143 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.636593 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.637172 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.674779 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:43.675296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:43.675828 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lazy-loading 'fault' on Instance uuid e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:13:43.722961 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:43.731170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-f820c9de-9ee7-4d6b-aacd-43d7a8e38c54 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 200 len: 1331 microversion: 2.1 time: 0.109627 Jul 28 18:13:43.731740 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 581/1177] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:43 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:43.736939 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2ece9821-992b-4153-bbc8-734e1c49f205 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:43.744680 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2ece9821-992b-4153-bbc8-734e1c49f205 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1577 microversion: 2.1 time: 0.214580 Jul 28 18:13:43.745905 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 597/1178] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:43 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:44.752714 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:44.753336 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:44.760349 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.760814 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.761598 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.762579 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.766850 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4ff00ebb-9a2c-421d-94c4-b0c8505e219b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:44.767598 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4ff00ebb-9a2c-421d-94c4-b0c8505e219b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:44.775131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ff00ebb-9a2c-421d-94c4-b0c8505e219b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.775902 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ff00ebb-9a2c-421d-94c4-b0c8505e219b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.777965 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ff00ebb-9a2c-421d-94c4-b0c8505e219b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:44.778615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4ff00ebb-9a2c-421d-94c4-b0c8505e219b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:44.778829 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b HTTP/1.1 Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:44.780536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:13:44.782194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b'} Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:44.783239 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:13:44.784693 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:44.785981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:44.785981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-433d275b-1a92-4e2a-875f-0af131777f98 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 404 len: 111 microversion: 2.1 time: 0.033200 Jul 28 18:13:44.785981 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 582/1179] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:44 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:13:44.791561 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-a794f59d-2e2d-48d6-ad2c-258226226a3f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '.version_select at 0x7fdae01aa550>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:44.854122 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-4ff00ebb-9a2c-421d-94c4-b0c8505e219b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:44.861878 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4ff00ebb-9a2c-421d-94c4-b0c8505e219b tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1225 microversion: 2.1 time: 0.099142 Jul 28 18:13:44.862536 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 598/1180] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:44 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1225 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:44.893431 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-a794f59d-2e2d-48d6-ad2c-258226226a3f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1395033711" status: 202 len: 0 microversion: 2.1 time: 0.106174 Jul 28 18:13:44.893919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 583/1181] 10.222.0.85 () {58 vars in 1221 bytes} [Thu Jul 28 18:13:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1395033711 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:13:45.596938 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-6570769f-d1db-4530-8e65-2da8aa09cd9a req-648df665-2bdd-4496-9173-294f47f96c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee5c512-be6b-4ace-a719-1111bf9781be", "name": "network-vif-deleted", "tag": "865b74cb-5e80-4ef5-a157-9e8ba6c62279"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:45.609615 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-6570769f-d1db-4530-8e65-2da8aa09cd9a req-648df665-2bdd-4496-9173-294f47f96c83 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.610061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-6570769f-d1db-4530-8e65-2da8aa09cd9a req-648df665-2bdd-4496-9173-294f47f96c83 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.622848 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-6570769f-d1db-4530-8e65-2da8aa09cd9a req-648df665-2bdd-4496-9173-294f47f96c83 service nova] Creating event network-vif-deleted:865b74cb-5e80-4ef5-a157-9e8ba6c62279 for instance 3ee5c512-be6b-4ace-a719-1111bf9781be on hv-cinder-83754 Jul 28 18:13:45.628037 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-6570769f-d1db-4530-8e65-2da8aa09cd9a req-648df665-2bdd-4496-9173-294f47f96c83 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035612 Jul 28 18:13:45.628643 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 599/1182] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:45.687111 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-6b03140d-f3e0-4fa8-aea7-a2a8bec3c4ae tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: .version_select at 0x7fdae041c3a0>, body: {"keypair": {"name": "tempest-keypair-664627698", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGBjc+aSQ9ZlRp96q9gYPvHwt1d6KtmmpmJJdQZXvRioZwPW+WVvBHgWuijxoLdFFzx7x6xQc6QdfwQZvh5wGwT7C0tK35rhvj7Lfx4HiVjSPQ8NEja0TV3or54hfLga7g=="}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:45.704625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-6b03140d-f3e0-4fa8-aea7-a2a8bec3c4ae tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:13:45.708536 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-6b03140d-f3e0-4fa8-aea7-a2a8bec3c4ae tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for user de20d8b31db44abf91a482d81b898755 and project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'key_pairs'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:13:45.884210 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:45.884905 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:45.891948 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.892393 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.893157 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.893588 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.905718 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-6b03140d-f3e0-4fa8-aea7-a2a8bec3c4ae tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.222705 Jul 28 18:13:45.908393 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 584/1183] 10.222.0.85 () {60 vars in 1159 bytes} [Thu Jul 28 18:13:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:45.926574 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:45.927025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:45.927474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lazy-loading 'fault' on Instance uuid 3ee5c512-be6b-4ace-a719-1111bf9781be {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:13:45.970668 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73edfd05da254457b6ad9c9c9f662e4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b1e6abd55a4b17b4a452a80a6bbdbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:45.977854 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-782f8655-1109-4241-8943-09b3b949cc18 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 200 len: 1184 microversion: 2.1 time: 0.098451 Jul 28 18:13:45.978810 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 600/1184] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:45 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 1184 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:13:46.999916 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:47.000519 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 3ee5c512-be6b-4ace-a719-1111bf9781be] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:47.007158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.007603 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.008366 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.008806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.022219 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] HTTP exception thrown: Instance 3ee5c512-be6b-4ace-a719-1111bf9781be could not be found. Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Request method failure captured: Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be HTTP/1.1 Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s_AXY_VHHcQahsxAU5bJ_e-A0sMj1nvn58EMe-BEXKOAUFRRxtXJImp79cmOZMhi4ncJ4oEFCRueyM5r84ougYMgq4s5MY5FJb4WXpn8R8ozOiiccb-OGRTQ4h7Qjb34RY7_7p0hnqOkp_mnqPyt72qxKKQV8winW6KuSZu2pFkNKw Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:47.023763 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a1b1e6abd55a4b17b4a452a80a6bbdbc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 73edfd05da254457b6ad9c9c9f662e4c Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 3ee5c512-be6b-4ace-a719-1111bf9781be could not be found. Jul 28 18:13:47.025395 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '3ee5c512-be6b-4ace-a719-1111bf9781be'} Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee5c512-be6b-4ace-a719-1111bf9781be could not be found. Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:47.027186 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee5c512-be6b-4ace-a719-1111bf9781be could not be found. Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee5c512-be6b-4ace-a719-1111bf9781be could not be found. Jul 28 18:13:47.028699 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.030148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Returning 404 to user: Instance 3ee5c512-be6b-4ace-a719-1111bf9781be could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:47.030148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ea7e6a8b-3759-4e11-850a-7ddbea8108c7 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be" status: 404 len: 111 microversion: 2.1 time: 0.029235 Jul 28 18:13:47.030148 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 585/1185] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:46 2022] GET /compute/v2.1/servers/3ee5c512-be6b-4ace-a719-1111bf9781be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:13:47.617808 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:47.618470 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:47.625919 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.628588 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.628588 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.628588 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.642893 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] HTTP exception thrown: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Request method failure captured: Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: DELETE /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 HTTP/1.1 Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4s_AXY_VHHcQahsxAU5bJ_e-A0sMj1nvn58EMe-BEXKOAUFRRxtXJImp79cmOZMhi4ncJ4oEFCRueyM5r84ougYMgq4s5MY5FJb4WXpn8R8ozOiiccb-OGRTQ4h7Qjb34RY7_7p0hnqOkp_mnqPyt72qxKKQV8winW6KuSZu2pFkNKw Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:13:47.645091 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a1b1e6abd55a4b17b4a452a80a6bbdbc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 73edfd05da254457b6ad9c9c9f662e4c Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.647226 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '1f1642e2-8e19-4214-8ada-503d731de538'} Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:47.647996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.649374 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.652125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Returning 404 to user: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:47.652125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f64e9e7f-00b8-480a-a313-39232eb051cf tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "DELETE /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 404 len: 111 microversion: 2.1 time: 0.032781 Jul 28 18:13:47.652125 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 601/1186] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:13:47 2022] DELETE /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:13:47.658027 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:47.658686 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] [instance: 1f1642e2-8e19-4214-8ada-503d731de538] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:47.665316 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.670532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.670532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:47.670532 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:47.685540 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] HTTP exception thrown: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Request method failure captured: Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 HTTP/1.1 Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4s_AXY_VHHcQahsxAU5bJ_e-A0sMj1nvn58EMe-BEXKOAUFRRxtXJImp79cmOZMhi4ncJ4oEFCRueyM5r84ougYMgq4s5MY5FJb4WXpn8R8ozOiiccb-OGRTQ4h7Qjb34RY7_7p0hnqOkp_mnqPyt72qxKKQV8winW6KuSZu2pFkNKw Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:13:47.687168 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_a1b1e6abd55a4b17b4a452a80a6bbdbc", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/a1b1e6abd55a4b17b4a452a80a6bbdbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: a1b1e6abd55a4b17b4a452a80a6bbdbc Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-TestVolumeBootPattern-1131198991 Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: 73edfd05da254457b6ad9c9c9f662e4c Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-TestVolumeBootPattern-1131198991-project Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.694435 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '1f1642e2-8e19-4214-8ada-503d731de538'} Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:13:47.695572 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. Jul 28 18:13:47.697036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:13:47.698595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Returning 404 to user: Instance 1f1642e2-8e19-4214-8ada-503d731de538 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:13:47.698595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-05dc5730-cbc0-4f54-8b87-48ebebf067f4 tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538" status: 404 len: 111 microversion: 2.1 time: 0.035052 Jul 28 18:13:47.698595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 586/1187] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:47 2022] GET /compute/v2.1/servers/1f1642e2-8e19-4214-8ada-503d731de538 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:13:48.871214 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2002332544", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7a1ed8c2-e3be-47b5-8608-0f5e33222798"}], "security_groups": [{"name": "tempest-securitygroup--750629323"}], "key_name": "tempest-keypair-664627698", "user_data": "}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:48.978837 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.network.neutron [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] validate_networks() for [('7a1ed8c2-e3be-47b5-8608-0f5e33222798', None, None, None, None, None)] {{(pid=130400) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:13:49.380591 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1e1cd10e-8f1f-44d6-9f4f-37c6e358a66d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] Calling method '.version_select at 0x7fdae01aa1f0>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:49.500393 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Flavor limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:13:49.500852 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Image limits 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:13:49.501328 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Flavor pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:13:49.501779 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Image pref 0:0:0 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:13:49.502198 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.virt.hardware [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130400) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:13:49.511783 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.512390 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.513203 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:49.513641 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:49.531209 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:13:49.535196 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.quota [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Getting quotas for user de20d8b31db44abf91a482d81b898755 and project b8daf9e3c7be417c82e7cbf8624d1d5d. Resources: {'instances', 'ram', 'cores'} {{(pid=130400) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:13:49.546719 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Going to run 1 instances... {{(pid=130400) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:13:49.549038 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130400) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:13:49.550335 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1e1cd10e-8f1f-44d6-9f4f-37c6e358a66d tempest-TestVolumeBootPattern-1131198991 tempest-TestVolumeBootPattern-1131198991-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1518406974" status: 202 len: 0 microversion: 2.1 time: 0.174857 Jul 28 18:13:49.550914 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 587/1188] 10.222.0.85 () {58 vars in 1263 bytes} [Thu Jul 28 18:13:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1518406974 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 18:13:49.740705 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-beae4e1f-2e8a-4192-a3fa-58678c5a8bbe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.873813 Jul 28 18:13:49.741583 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 602/1189] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:13:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:13:49.752912 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-11847ebf-9fd7-4500-ac8c-8d6074387a8e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:49.753525 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-11847ebf-9fd7-4500-ac8c-8d6074387a8e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:49.823697 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-11847ebf-9fd7-4500-ac8c-8d6074387a8e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:49.833296 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-11847ebf-9fd7-4500-ac8c-8d6074387a8e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1241 microversion: 2.1 time: 0.084089 Jul 28 18:13:49.834552 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 588/1190] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:49 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:50.861305 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-2dc0dcbf-37fd-41e8-9ae3-96f2aeeb6f87 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:50.862501 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-2dc0dcbf-37fd-41e8-9ae3-96f2aeeb6f87 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:50.872793 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2dc0dcbf-37fd-41e8-9ae3-96f2aeeb6f87 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:50.875797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2dc0dcbf-37fd-41e8-9ae3-96f2aeeb6f87 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:50.875797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2dc0dcbf-37fd-41e8-9ae3-96f2aeeb6f87 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:50.875797 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-2dc0dcbf-37fd-41e8-9ae3-96f2aeeb6f87 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:50.938865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-2dc0dcbf-37fd-41e8-9ae3-96f2aeeb6f87 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:50.947095 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-2dc0dcbf-37fd-41e8-9ae3-96f2aeeb6f87 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1245 microversion: 2.1 time: 0.095542 Jul 28 18:13:50.948433 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 603/1191] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:50 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:51.968616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0467906b-e1a5-4590-b01b-8c63713d40e6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:51.971036 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0467906b-e1a5-4590-b01b-8c63713d40e6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:51.977628 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0467906b-e1a5-4590-b01b-8c63713d40e6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:51.978260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0467906b-e1a5-4590-b01b-8c63713d40e6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:51.979258 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0467906b-e1a5-4590-b01b-8c63713d40e6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:51.979844 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0467906b-e1a5-4590-b01b-8c63713d40e6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:52.047023 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-0467906b-e1a5-4590-b01b-8c63713d40e6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:52.054746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0467906b-e1a5-4590-b01b-8c63713d40e6 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1293 microversion: 2.1 time: 0.090285 Jul 28 18:13:52.055310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 589/1192] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:51 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:53.078113 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-91c4a471-6370-4d57-b11f-805f8e72fb92 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:53.078919 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-91c4a471-6370-4d57-b11f-805f8e72fb92 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:53.086293 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-91c4a471-6370-4d57-b11f-805f8e72fb92 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:53.086791 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-91c4a471-6370-4d57-b11f-805f8e72fb92 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:53.087573 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-91c4a471-6370-4d57-b11f-805f8e72fb92 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:53.088225 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-91c4a471-6370-4d57-b11f-805f8e72fb92 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:53.186447 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-91c4a471-6370-4d57-b11f-805f8e72fb92 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:53.196076 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-91c4a471-6370-4d57-b11f-805f8e72fb92 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1311 microversion: 2.1 time: 0.121980 Jul 28 18:13:53.197055 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 604/1193] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:53 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:54.220854 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ad7ab9eb-a06a-401f-8f47-026c0de30a42 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:54.222528 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ad7ab9eb-a06a-401f-8f47-026c0de30a42 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:54.229028 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad7ab9eb-a06a-401f-8f47-026c0de30a42 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:54.229490 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad7ab9eb-a06a-401f-8f47-026c0de30a42 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:54.230377 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad7ab9eb-a06a-401f-8f47-026c0de30a42 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:54.230886 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ad7ab9eb-a06a-401f-8f47-026c0de30a42 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:54.251511 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:13:54.377476 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ad7ab9eb-a06a-401f-8f47-026c0de30a42 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:54.387109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ad7ab9eb-a06a-401f-8f47-026c0de30a42 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1366 microversion: 2.1 time: 0.170042 Jul 28 18:13:54.387975 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 590/1194] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:54 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:55.223527 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-f8c702e1-9c91-4d47-aebe-43df74cff581 req-6a5b5199-b6c7-4c96-beff-f3d30298d9ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98bdea7-b9a4-48fa-a509-a9abfff41796", "tag": "9e90b8d5-026a-4772-9455-d60901486ae8"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:13:55.247029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-f8c702e1-9c91-4d47-aebe-43df74cff581 req-6a5b5199-b6c7-4c96-beff-f3d30298d9ef service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:55.247029 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-f8c702e1-9c91-4d47-aebe-43df74cff581 req-6a5b5199-b6c7-4c96-beff-f3d30298d9ef service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:55.280579 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-f8c702e1-9c91-4d47-aebe-43df74cff581 req-6a5b5199-b6c7-4c96-beff-f3d30298d9ef service nova] Creating event network-changed:9e90b8d5-026a-4772-9455-d60901486ae8 for instance a98bdea7-b9a4-48fa-a509-a9abfff41796 on hv-cinder-83754 Jul 28 18:13:55.287384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-f8c702e1-9c91-4d47-aebe-43df74cff581 req-6a5b5199-b6c7-4c96-beff-f3d30298d9ef service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074664 Jul 28 18:13:55.288241 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 605/1195] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:13:55.410194 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-86df7b3f-51c4-490a-b042-d75f076ee099 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:55.410849 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-86df7b3f-51c4-490a-b042-d75f076ee099 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:55.425805 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86df7b3f-51c4-490a-b042-d75f076ee099 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:55.426271 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86df7b3f-51c4-490a-b042-d75f076ee099 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:55.434446 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86df7b3f-51c4-490a-b042-d75f076ee099 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:55.443306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-86df7b3f-51c4-490a-b042-d75f076ee099 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:55.589595 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-86df7b3f-51c4-490a-b042-d75f076ee099 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:55.597509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-86df7b3f-51c4-490a-b042-d75f076ee099 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1366 microversion: 2.1 time: 0.192137 Jul 28 18:13:55.598082 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 591/1196] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:55 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:56.620291 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7fb5927f-a5fe-4b73-9bd5-82c905c290ab tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:56.621114 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7fb5927f-a5fe-4b73-9bd5-82c905c290ab tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:56.627977 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7fb5927f-a5fe-4b73-9bd5-82c905c290ab tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:56.628427 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7fb5927f-a5fe-4b73-9bd5-82c905c290ab tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:56.629207 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7fb5927f-a5fe-4b73-9bd5-82c905c290ab tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:56.629642 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7fb5927f-a5fe-4b73-9bd5-82c905c290ab tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:56.806384 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7fb5927f-a5fe-4b73-9bd5-82c905c290ab tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:56.816501 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7fb5927f-a5fe-4b73-9bd5-82c905c290ab tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1366 microversion: 2.1 time: 0.200780 Jul 28 18:13:56.817067 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 606/1197] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:56 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:57.838635 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-363e2758-d880-42e1-8787-a07fffe320da tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:57.839382 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-363e2758-d880-42e1-8787-a07fffe320da tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:57.847306 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-363e2758-d880-42e1-8787-a07fffe320da tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:57.847995 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-363e2758-d880-42e1-8787-a07fffe320da tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:57.848777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-363e2758-d880-42e1-8787-a07fffe320da tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:57.849333 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-363e2758-d880-42e1-8787-a07fffe320da tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:58.013068 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-363e2758-d880-42e1-8787-a07fffe320da tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:58.021242 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-363e2758-d880-42e1-8787-a07fffe320da tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1366 microversion: 2.1 time: 0.187766 Jul 28 18:13:58.022119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 592/1198] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:57 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:59.043729 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6673d6cb-73c4-415e-94f6-77574b759d7f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:13:59.045160 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6673d6cb-73c4-415e-94f6-77574b759d7f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:13:59.053936 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6673d6cb-73c4-415e-94f6-77574b759d7f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:59.054769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6673d6cb-73c4-415e-94f6-77574b759d7f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:59.056248 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6673d6cb-73c4-415e-94f6-77574b759d7f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:13:59.057402 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6673d6cb-73c4-415e-94f6-77574b759d7f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:13:59.190514 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-6673d6cb-73c4-415e-94f6-77574b759d7f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:13:59.198793 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6673d6cb-73c4-415e-94f6-77574b759d7f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1366 microversion: 2.1 time: 0.159544 Jul 28 18:13:59.199483 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 607/1199] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:13:59 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:13:59.829004 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=6 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:00.046760 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-38c59b9f-1d73-4eea-bf22-d735f928a940 req-afa39795-dafb-4ada-bc8c-77eabc31f41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98bdea7-b9a4-48fa-a509-a9abfff41796", "name": "network-vif-plugged", "status": "completed", "tag": "9e90b8d5-026a-4772-9455-d60901486ae8"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:00.057417 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-38c59b9f-1d73-4eea-bf22-d735f928a940 req-afa39795-dafb-4ada-bc8c-77eabc31f41b service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:00.057928 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-38c59b9f-1d73-4eea-bf22-d735f928a940 req-afa39795-dafb-4ada-bc8c-77eabc31f41b service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:00.070291 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-38c59b9f-1d73-4eea-bf22-d735f928a940 req-afa39795-dafb-4ada-bc8c-77eabc31f41b service nova] Creating event network-vif-plugged:9e90b8d5-026a-4772-9455-d60901486ae8 for instance a98bdea7-b9a4-48fa-a509-a9abfff41796 on hv-cinder-83754 Jul 28 18:14:00.075620 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-38c59b9f-1d73-4eea-bf22-d735f928a940 req-afa39795-dafb-4ada-bc8c-77eabc31f41b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.366017 Jul 28 18:14:00.076370 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 593/1200] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:00.220526 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5a3b5f62-03da-47da-818a-90e27a2787d2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:00.221173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5a3b5f62-03da-47da-818a-90e27a2787d2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:00.223145 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=2 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:00.223835 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=6 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:00.229668 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5a3b5f62-03da-47da-818a-90e27a2787d2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:00.230301 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5a3b5f62-03da-47da-818a-90e27a2787d2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:00.230907 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5a3b5f62-03da-47da-818a-90e27a2787d2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:00.231345 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5a3b5f62-03da-47da-818a-90e27a2787d2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:00.374090 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5a3b5f62-03da-47da-818a-90e27a2787d2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:00.382280 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5a3b5f62-03da-47da-818a-90e27a2787d2 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1366 microversion: 2.1 time: 0.165790 Jul 28 18:14:00.382891 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 608/1201] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:00 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:01.405123 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-53be3722-ceeb-49ea-917f-49bd58a99c04 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:01.405852 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-53be3722-ceeb-49ea-917f-49bd58a99c04 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:01.412372 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-53be3722-ceeb-49ea-917f-49bd58a99c04 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:01.412818 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-53be3722-ceeb-49ea-917f-49bd58a99c04 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:01.413581 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-53be3722-ceeb-49ea-917f-49bd58a99c04 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:01.414014 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-53be3722-ceeb-49ea-917f-49bd58a99c04 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:01.561078 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-53be3722-ceeb-49ea-917f-49bd58a99c04 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:01.570450 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-53be3722-ceeb-49ea-917f-49bd58a99c04 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1366 microversion: 2.1 time: 0.170479 Jul 28 18:14:01.582711 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 594/1202] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:01 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:02.595011 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-aa2ae27a-53af-4383-aa7d-b3eb486eb2fe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:02.595625 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-aa2ae27a-53af-4383-aa7d-b3eb486eb2fe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:02.603149 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aa2ae27a-53af-4383-aa7d-b3eb486eb2fe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:02.603895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aa2ae27a-53af-4383-aa7d-b3eb486eb2fe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:02.604645 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aa2ae27a-53af-4383-aa7d-b3eb486eb2fe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:02.605085 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-aa2ae27a-53af-4383-aa7d-b3eb486eb2fe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:02.737566 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-aa2ae27a-53af-4383-aa7d-b3eb486eb2fe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:02.745818 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-aa2ae27a-53af-4383-aa7d-b3eb486eb2fe tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1556 microversion: 2.1 time: 0.155072 Jul 28 18:14:02.746405 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 609/1203] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:02 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:02.767560 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-e532feec-790a-452c-9b11-73ceae7c94cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:02.768075 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-e532feec-790a-452c-9b11-73ceae7c94cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:02.775067 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e532feec-790a-452c-9b11-73ceae7c94cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:02.775663 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e532feec-790a-452c-9b11-73ceae7c94cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:02.776539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e532feec-790a-452c-9b11-73ceae7c94cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:02.776974 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-e532feec-790a-452c-9b11-73ceae7c94cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:02.866283 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-e532feec-790a-452c-9b11-73ceae7c94cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102980 Jul 28 18:14:02.866925 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 595/1204] 10.222.0.85 () {58 vars in 1275 bytes} [Thu Jul 28 18:14:02 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:04.161054 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [req-ac8be92a-1de5-4ecb-b132-b753d92b6c70 req-6be65459-e354-42ec-99b1-b3b145fdde9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98bdea7-b9a4-48fa-a509-a9abfff41796", "tag": "9e90b8d5-026a-4772-9455-d60901486ae8"}]} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:04.174386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-ac8be92a-1de5-4ecb-b132-b753d92b6c70 req-6be65459-e354-42ec-99b1-b3b145fdde9a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:04.174813 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [req-ac8be92a-1de5-4ecb-b132-b753d92b6c70 req-6be65459-e354-42ec-99b1-b3b145fdde9a service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:04.193635 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.compute.server_external_events [req-ac8be92a-1de5-4ecb-b132-b753d92b6c70 req-6be65459-e354-42ec-99b1-b3b145fdde9a service nova] Creating event network-changed:9e90b8d5-026a-4772-9455-d60901486ae8 for instance a98bdea7-b9a4-48fa-a509-a9abfff41796 on hv-cinder-83754 Jul 28 18:14:04.199672 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [req-ac8be92a-1de5-4ecb-b132-b753d92b6c70 req-6be65459-e354-42ec-99b1-b3b145fdde9a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042336 Jul 28 18:14:04.200630 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 610/1205] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:37.853760 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:37.854720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=27 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:37.859180 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-633332428", "imageRef": "cf338b24-fb53-4a2f-8e72-036671e2c85a", "flavorRef": "452"}} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:37.911200 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.network.neutron [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] validate_networks() for None {{(pid=130401) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 18:14:38.187692 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Flavor limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 18:14:38.188112 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Image limits 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 18:14:38.188587 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Flavor pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 18:14:38.188994 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Image pref 0:0:0 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 18:14:38.189402 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.virt.hardware [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130401) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 18:14:38.198509 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:38.198957 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:38.199753 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:38.200187 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:38.218380 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Getting quotas for project 6d8a4598dd0741fabc1b38917626e133. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 18:14:38.222303 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.quota [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Getting quotas for user 965acd6b6b44472ebf6511f4cbb54b45 and project 6d8a4598dd0741fabc1b38917626e133. Resources: {'instances', 'ram', 'cores'} {{(pid=130401) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 18:14:38.233327 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Going to run 1 instances... {{(pid=130401) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 18:14:38.235609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='cf338b24-fb53-4a2f-8e72-036671e2c85a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130401) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 18:14:38.433913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0d8dbbac-093d-46cb-98e6-eecff83c48ec tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581657 Jul 28 18:14:38.434500 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 596/1206] 10.222.0.85 () {60 vars in 1147 bytes} [Thu Jul 28 18:14:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 18:14:38.444269 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:38.445025 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=93 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:38.449115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff3728ad-df3b-49af-9f18-6ce1e8b92459 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:38.450864 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ff3728ad-df3b-49af-9f18-6ce1e8b92459 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:38.510942 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-ff3728ad-df3b-49af-9f18-6ce1e8b92459 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:38.519389 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ff3728ad-df3b-49af-9f18-6ce1e8b92459 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1214 microversion: 2.1 time: 0.077104 Jul 28 18:14:38.519992 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 611/1207] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:38 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:38.997808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-144092ed-3246-4a66-af7f-b1156eae3417 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:38.999015 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-144092ed-3246-4a66-af7f-b1156eae3417 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:39.005596 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-144092ed-3246-4a66-af7f-b1156eae3417 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:39.009498 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-144092ed-3246-4a66-af7f-b1156eae3417 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:39.009498 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-144092ed-3246-4a66-af7f-b1156eae3417 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:39.009498 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-144092ed-3246-4a66-af7f-b1156eae3417 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:39.030857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-144092ed-3246-4a66-af7f-b1156eae3417 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/ips" status: 200 len: 150 microversion: 2.1 time: 0.037212 Jul 28 18:14:39.031683 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 597/1208] 10.222.0.85 () {58 vars in 1248 bytes} [Thu Jul 28 18:14:38 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:39.540540 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-dbf73dc7-6382-4217-bf51-955c700243ce tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:39.541146 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-dbf73dc7-6382-4217-bf51-955c700243ce tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:39.596915 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-dbf73dc7-6382-4217-bf51-955c700243ce tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:39.604328 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-dbf73dc7-6382-4217-bf51-955c700243ce tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1214 microversion: 2.1 time: 0.067791 Jul 28 18:14:39.604881 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 612/1209] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:39 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:40.625357 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8b219ead-d7fb-4518-b8fb-ac399a394f66 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:40.625952 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8b219ead-d7fb-4518-b8fb-ac399a394f66 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:40.632657 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b219ead-d7fb-4518-b8fb-ac399a394f66 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.633161 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b219ead-d7fb-4518-b8fb-ac399a394f66 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:40.633849 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b219ead-d7fb-4518-b8fb-ac399a394f66 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.634276 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8b219ead-d7fb-4518-b8fb-ac399a394f66 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:40.698599 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8b219ead-d7fb-4518-b8fb-ac399a394f66 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:40.706392 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8b219ead-d7fb-4518-b8fb-ac399a394f66 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1266 microversion: 2.1 time: 0.085252 Jul 28 18:14:40.706952 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 598/1210] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:40 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 18:14:40.823451 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8a1c5119-b2da-4021-8912-dddb40ae4291 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76ce903e-5123-4b40-b8a9-4724b3a22bdd"}} {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:40.825886 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8a1c5119-b2da-4021-8912-dddb40ae4291 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:40.832984 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a1c5119-b2da-4021-8912-dddb40ae4291 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.833467 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a1c5119-b2da-4021-8912-dddb40ae4291 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:40.834264 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a1c5119-b2da-4021-8912-dddb40ae4291 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:40.834723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8a1c5119-b2da-4021-8912-dddb40ae4291 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:41.716451 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8a1c5119-b2da-4021-8912-dddb40ae4291 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "POST /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896691 Jul 28 18:14:41.717261 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 613/1211] 10.222.0.85 () {60 vars in 1323 bytes} [Thu Jul 28 18:14:40 2022] POST /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments => generated 194 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:41.732160 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-d18815f9-8257-46f1-963c-066b47751336 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:41.732839 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-d18815f9-8257-46f1-963c-066b47751336 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:41.741936 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d18815f9-8257-46f1-963c-066b47751336 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:41.742399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d18815f9-8257-46f1-963c-066b47751336 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:41.744746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d18815f9-8257-46f1-963c-066b47751336 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:41.745196 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-d18815f9-8257-46f1-963c-066b47751336 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:41.818249 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-d18815f9-8257-46f1-963c-066b47751336 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:41.825771 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-d18815f9-8257-46f1-963c-066b47751336 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1272 microversion: 2.1 time: 0.097666 Jul 28 18:14:41.826365 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 599/1212] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:41 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:42.850494 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3a699629-ae0e-40a3-9e62-77ce4ac473e0 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:42.852272 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3a699629-ae0e-40a3-9e62-77ce4ac473e0 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:42.860833 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3a699629-ae0e-40a3-9e62-77ce4ac473e0 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:42.861363 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3a699629-ae0e-40a3-9e62-77ce4ac473e0 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:42.862380 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3a699629-ae0e-40a3-9e62-77ce4ac473e0 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:42.862891 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3a699629-ae0e-40a3-9e62-77ce4ac473e0 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:43.067846 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3a699629-ae0e-40a3-9e62-77ce4ac473e0 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:43.075935 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3a699629-ae0e-40a3-9e62-77ce4ac473e0 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1314 microversion: 2.1 time: 0.230818 Jul 28 18:14:43.076583 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 614/1213] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:42 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:43.256246 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-4a22f6fd-2ea1-416c-9e3e-8c447efdfe4e req-7cbde4a8-b6d3-4576-b090-9d36b5880b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2145474e-af1c-4805-8d6f-54a7b8c56eba", "tag": "4b7c2b04-d1dc-438f-9eee-c7d25b553ac4"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:43.269748 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-4a22f6fd-2ea1-416c-9e3e-8c447efdfe4e req-7cbde4a8-b6d3-4576-b090-9d36b5880b5f service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:43.270611 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-4a22f6fd-2ea1-416c-9e3e-8c447efdfe4e req-7cbde4a8-b6d3-4576-b090-9d36b5880b5f service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:43.283515 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-4a22f6fd-2ea1-416c-9e3e-8c447efdfe4e req-7cbde4a8-b6d3-4576-b090-9d36b5880b5f service nova] Creating event network-changed:4b7c2b04-d1dc-438f-9eee-c7d25b553ac4 for instance 2145474e-af1c-4805-8d6f-54a7b8c56eba on hv-cinder-83754 Jul 28 18:14:43.288559 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-4a22f6fd-2ea1-416c-9e3e-8c447efdfe4e req-7cbde4a8-b6d3-4576-b090-9d36b5880b5f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038274 Jul 28 18:14:43.289261 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 600/1214] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:44.097995 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0ebe7397-da8a-4354-ac6b-c2fd367ef616 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:44.098616 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0ebe7397-da8a-4354-ac6b-c2fd367ef616 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:44.105496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ebe7397-da8a-4354-ac6b-c2fd367ef616 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:44.105941 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ebe7397-da8a-4354-ac6b-c2fd367ef616 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:44.106739 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ebe7397-da8a-4354-ac6b-c2fd367ef616 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:44.107173 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0ebe7397-da8a-4354-ac6b-c2fd367ef616 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:44.240898 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-0ebe7397-da8a-4354-ac6b-c2fd367ef616 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:44.249474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0ebe7397-da8a-4354-ac6b-c2fd367ef616 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1314 microversion: 2.1 time: 0.154702 Jul 28 18:14:44.249684 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 615/1215] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:44 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:45.271342 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9d99d940-816f-42d9-9888-121b46c6b4c2 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:45.272059 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9d99d940-816f-42d9-9888-121b46c6b4c2 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:45.278328 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9d99d940-816f-42d9-9888-121b46c6b4c2 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:45.278805 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9d99d940-816f-42d9-9888-121b46c6b4c2 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:45.279554 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9d99d940-816f-42d9-9888-121b46c6b4c2 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:45.280152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9d99d940-816f-42d9-9888-121b46c6b4c2 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:45.416213 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-9d99d940-816f-42d9-9888-121b46c6b4c2 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:45.424479 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9d99d940-816f-42d9-9888-121b46c6b4c2 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1314 microversion: 2.1 time: 0.158082 Jul 28 18:14:45.425048 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 601/1216] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:45 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:46.445925 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-7c187df3-43f1-43f7-bce8-33e48ce8572a tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:46.446565 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-7c187df3-43f1-43f7-bce8-33e48ce8572a tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:46.452967 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c187df3-43f1-43f7-bce8-33e48ce8572a tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:46.453409 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c187df3-43f1-43f7-bce8-33e48ce8572a tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:46.454544 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c187df3-43f1-43f7-bce8-33e48ce8572a tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:46.454980 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-7c187df3-43f1-43f7-bce8-33e48ce8572a tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:46.586895 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-7c187df3-43f1-43f7-bce8-33e48ce8572a tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:46.595155 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-7c187df3-43f1-43f7-bce8-33e48ce8572a tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1314 microversion: 2.1 time: 0.152467 Jul 28 18:14:46.595727 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 616/1217] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:46 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:47.616746 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-8cb3a691-ca10-4106-8468-a035038651c9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:47.617363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-8cb3a691-ca10-4106-8468-a035038651c9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:47.623865 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8cb3a691-ca10-4106-8468-a035038651c9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:47.624309 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8cb3a691-ca10-4106-8468-a035038651c9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:47.625074 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8cb3a691-ca10-4106-8468-a035038651c9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:47.626218 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-8cb3a691-ca10-4106-8468-a035038651c9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:47.759806 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-8cb3a691-ca10-4106-8468-a035038651c9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:47.768482 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-8cb3a691-ca10-4106-8468-a035038651c9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1314 microversion: 2.1 time: 0.155568 Jul 28 18:14:47.769198 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 602/1218] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:47 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:48.789172 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-00488479-f9b1-4b28-ad3a-7dbb5296b8bc tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:48.789816 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-00488479-f9b1-4b28-ad3a-7dbb5296b8bc tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:48.796379 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-00488479-f9b1-4b28-ad3a-7dbb5296b8bc tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:48.796863 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-00488479-f9b1-4b28-ad3a-7dbb5296b8bc tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:48.797749 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-00488479-f9b1-4b28-ad3a-7dbb5296b8bc tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:48.798282 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-00488479-f9b1-4b28-ad3a-7dbb5296b8bc tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:48.928996 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-00488479-f9b1-4b28-ad3a-7dbb5296b8bc tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:48.936477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-00488479-f9b1-4b28-ad3a-7dbb5296b8bc tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1314 microversion: 2.1 time: 0.151303 Jul 28 18:14:48.937036 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 617/1219] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:48 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:49.884857 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-05d179bb-12c9-4ff7-9ac8-dab3056ebdce req-8318f88f-f8e3-48f6-a4b0-7f2fbcbcc206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2145474e-af1c-4805-8d6f-54a7b8c56eba", "name": "network-vif-plugged", "status": "completed", "tag": "4b7c2b04-d1dc-438f-9eee-c7d25b553ac4"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:49.891005 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=2 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:49.892094 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell0:SELECT=6 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:49.901726 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-05d179bb-12c9-4ff7-9ac8-dab3056ebdce req-8318f88f-f8e3-48f6-a4b0-7f2fbcbcc206 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:49.901726 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-05d179bb-12c9-4ff7-9ac8-dab3056ebdce req-8318f88f-f8e3-48f6-a4b0-7f2fbcbcc206 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:49.912399 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-05d179bb-12c9-4ff7-9ac8-dab3056ebdce req-8318f88f-f8e3-48f6-a4b0-7f2fbcbcc206 service nova] Creating event network-vif-plugged:4b7c2b04-d1dc-438f-9eee-c7d25b553ac4 for instance 2145474e-af1c-4805-8d6f-54a7b8c56eba on hv-cinder-83754 Jul 28 18:14:49.917495 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-05d179bb-12c9-4ff7-9ac8-dab3056ebdce req-8318f88f-f8e3-48f6-a4b0-7f2fbcbcc206 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036423 Jul 28 18:14:49.918245 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 603/1220] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:49.958942 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-cfdd23e5-83c3-4007-82c1-8f97bc6d6ea3 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:49.959543 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-cfdd23e5-83c3-4007-82c1-8f97bc6d6ea3 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:49.961552 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell0:SELECT=4 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:49.967426 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cfdd23e5-83c3-4007-82c1-8f97bc6d6ea3 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:49.967756 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cfdd23e5-83c3-4007-82c1-8f97bc6d6ea3 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:49.968530 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cfdd23e5-83c3-4007-82c1-8f97bc6d6ea3 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:49.968966 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-cfdd23e5-83c3-4007-82c1-8f97bc6d6ea3 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:50.103506 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-cfdd23e5-83c3-4007-82c1-8f97bc6d6ea3 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:50.112295 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-cfdd23e5-83c3-4007-82c1-8f97bc6d6ea3 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1314 microversion: 2.1 time: 0.158889 Jul 28 18:14:50.112882 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 618/1221] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:49 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:50.445777 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-372e186f-52b3-4d34-ac81-0f6310d3da23 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:50.447787 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-372e186f-52b3-4d34-ac81-0f6310d3da23 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:50.453507 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-372e186f-52b3-4d34-ac81-0f6310d3da23 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:50.454614 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-372e186f-52b3-4d34-ac81-0f6310d3da23 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:50.455489 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-372e186f-52b3-4d34-ac81-0f6310d3da23 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:50.455929 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-372e186f-52b3-4d34-ac81-0f6310d3da23 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:50.538502 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-372e186f-52b3-4d34-ac81-0f6310d3da23 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lazy-loading 'services' on Instance uuid a98bdea7-b9a4-48fa-a509-a9abfff41796 {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:14:50.809474 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-372e186f-52b3-4d34-ac81-0f6310d3da23 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments/76ce903e-5123-4b40-b8a9-4724b3a22bdd" status: 202 len: 0 microversion: 2.1 time: 0.368470 Jul 28 18:14:50.809994 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 604/1222] 10.222.0.85 () {58 vars in 1416 bytes} [Thu Jul 28 18:14:50 2022] DELETE /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments/76ce903e-5123-4b40-b8a9-4724b3a22bdd => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:14:50.819179 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-0e4e08b6-d812-45ac-8eb7-fad691af9477 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:50.821386 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-0e4e08b6-d812-45ac-8eb7-fad691af9477 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:50.827748 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0e4e08b6-d812-45ac-8eb7-fad691af9477 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:50.828188 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0e4e08b6-d812-45ac-8eb7-fad691af9477 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:50.829115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0e4e08b6-d812-45ac-8eb7-fad691af9477 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:50.829578 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-0e4e08b6-d812-45ac-8eb7-fad691af9477 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:50.859592 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-0e4e08b6-d812-45ac-8eb7-fad691af9477 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Jul 28 18:14:50.860696 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 619/1223] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:14:50 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:51.133422 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-aa8066bd-64fe-4caa-9970-aa19a3d6ff21 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:51.134235 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-aa8066bd-64fe-4caa-9970-aa19a3d6ff21 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:51.140999 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa8066bd-64fe-4caa-9970-aa19a3d6ff21 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.141483 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa8066bd-64fe-4caa-9970-aa19a3d6ff21 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.142260 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa8066bd-64fe-4caa-9970-aa19a3d6ff21 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.142731 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-aa8066bd-64fe-4caa-9970-aa19a3d6ff21 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.272728 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-aa8066bd-64fe-4caa-9970-aa19a3d6ff21 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:51.280119 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-aa8066bd-64fe-4caa-9970-aa19a3d6ff21 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1314 microversion: 2.1 time: 0.150873 Jul 28 18:14:51.280680 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 605/1224] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:51 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:51.873061 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8c1809ce-e103-4bf7-bb10-bbdb1a20931d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:51.875305 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8c1809ce-e103-4bf7-bb10-bbdb1a20931d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:51.882361 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8c1809ce-e103-4bf7-bb10-bbdb1a20931d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.882817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8c1809ce-e103-4bf7-bb10-bbdb1a20931d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.883621 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8c1809ce-e103-4bf7-bb10-bbdb1a20931d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:51.884057 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8c1809ce-e103-4bf7-bb10-bbdb1a20931d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:51.916669 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8c1809ce-e103-4bf7-bb10-bbdb1a20931d tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047865 Jul 28 18:14:51.917225 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 620/1225] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:14:51 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:52.301643 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-ab385f80-d46b-4229-bec0-92f68e7c8548 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:52.302272 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-ab385f80-d46b-4229-bec0-92f68e7c8548 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:52.308913 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab385f80-d46b-4229-bec0-92f68e7c8548 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.309363 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab385f80-d46b-4229-bec0-92f68e7c8548 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.310278 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab385f80-d46b-4229-bec0-92f68e7c8548 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.310745 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-ab385f80-d46b-4229-bec0-92f68e7c8548 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.446037 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-ab385f80-d46b-4229-bec0-92f68e7c8548 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:52.453491 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-ab385f80-d46b-4229-bec0-92f68e7c8548 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1463 microversion: 2.1 time: 0.156283 Jul 28 18:14:52.454170 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 606/1226] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:52 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1463 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:52.499825 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-6f23b515-833e-4c9e-b164-913c530a17bb tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:52.500324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6f23b515-833e-4c9e-b164-913c530a17bb tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:52.506475 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6f23b515-833e-4c9e-b164-913c530a17bb tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.506927 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6f23b515-833e-4c9e-b164-913c530a17bb tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.507695 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6f23b515-833e-4c9e-b164-913c530a17bb tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.508131 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-6f23b515-833e-4c9e-b164-913c530a17bb tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.533676 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-6f23b515-833e-4c9e-b164-913c530a17bb tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Going to try to terminate instance {{(pid=130400) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:14:52.838388 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-6f23b515-833e-4c9e-b164-913c530a17bb tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 204 len: 0 microversion: 2.1 time: 0.342087 Jul 28 18:14:52.839357 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 621/1227] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:14:52 2022] DELETE /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:14:52.848294 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-593b5d31-cb89-42a2-ba61-b3b112d7ef94 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:52.848942 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-593b5d31-cb89-42a2-ba61-b3b112d7ef94 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:52.854948 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-593b5d31-cb89-42a2-ba61-b3b112d7ef94 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.855396 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-593b5d31-cb89-42a2-ba61-b3b112d7ef94 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.856158 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-593b5d31-cb89-42a2-ba61-b3b112d7ef94 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.861709 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-593b5d31-cb89-42a2-ba61-b3b112d7ef94 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.930187 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-940adf83-1d13-4c42-8091-e663ee5686cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:52.932477 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-940adf83-1d13-4c42-8091-e663ee5686cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:52.939200 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-940adf83-1d13-4c42-8091-e663ee5686cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.939665 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-940adf83-1d13-4c42-8091-e663ee5686cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.940432 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-940adf83-1d13-4c42-8091-e663ee5686cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:52.940865 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-940adf83-1d13-4c42-8091-e663ee5686cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:52.971708 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-940adf83-1d13-4c42-8091-e663ee5686cf tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045893 Jul 28 18:14:52.972276 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 622/1228] 10.222.0.85 () {58 vars in 1302 bytes} [Thu Jul 28 18:14:52 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 28 18:14:52.989497 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-593b5d31-cb89-42a2-ba61-b3b112d7ef94 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:52.996862 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-593b5d31-cb89-42a2-ba61-b3b112d7ef94 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1469 microversion: 2.1 time: 0.152994 Jul 28 18:14:52.997420 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 607/1229] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:52 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:53.035679 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-f19db720-ab64-4c3f-9cd4-1f30c799a623 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:53.036204 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f19db720-ab64-4c3f-9cd4-1f30c799a623 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:53.042214 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f19db720-ab64-4c3f-9cd4-1f30c799a623 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:53.042698 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f19db720-ab64-4c3f-9cd4-1f30c799a623 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:53.043489 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f19db720-ab64-4c3f-9cd4-1f30c799a623 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:53.043926 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-f19db720-ab64-4c3f-9cd4-1f30c799a623 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:53.068150 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-f19db720-ab64-4c3f-9cd4-1f30c799a623 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Going to try to terminate instance {{(pid=130400) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 18:14:53.381474 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-f19db720-ab64-4c3f-9cd4-1f30c799a623 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 204 len: 0 microversion: 2.1 time: 0.349815 Jul 28 18:14:53.382209 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 623/1230] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:14:53 2022] DELETE /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 18:14:53.390380 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7734f2df-0407-49e4-bfa7-bdbd12fb67e9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:53.391065 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7734f2df-0407-49e4-bfa7-bdbd12fb67e9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:53.398157 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7734f2df-0407-49e4-bfa7-bdbd12fb67e9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:53.398628 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7734f2df-0407-49e4-bfa7-bdbd12fb67e9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:53.399377 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7734f2df-0407-49e4-bfa7-bdbd12fb67e9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:53.399808 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7734f2df-0407-49e4-bfa7-bdbd12fb67e9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:53.532670 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7734f2df-0407-49e4-bfa7-bdbd12fb67e9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:53.540295 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7734f2df-0407-49e4-bfa7-bdbd12fb67e9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1681 microversion: 2.1 time: 0.153748 Jul 28 18:14:53.540867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 608/1231] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:53 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:54.018733 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1d9d4e87-b00b-47fa-8651-22371f550dcd tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:54.019432 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1d9d4e87-b00b-47fa-8651-22371f550dcd tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:54.025888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1d9d4e87-b00b-47fa-8651-22371f550dcd tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:54.026324 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1d9d4e87-b00b-47fa-8651-22371f550dcd tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:54.027102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1d9d4e87-b00b-47fa-8651-22371f550dcd tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:54.027586 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1d9d4e87-b00b-47fa-8651-22371f550dcd tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:54.157971 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-1d9d4e87-b00b-47fa-8651-22371f550dcd tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:54.161592 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG dbcounter [-] [130400] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=130400) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:14:54.166500 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1d9d4e87-b00b-47fa-8651-22371f550dcd tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1469 microversion: 2.1 time: 0.153071 Jul 28 18:14:54.167069 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 624/1232] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:54 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:54.562245 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-141293b3-b459-4b6e-9940-a9c7670d2f9b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:54.562878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-141293b3-b459-4b6e-9940-a9c7670d2f9b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:54.569964 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-141293b3-b459-4b6e-9940-a9c7670d2f9b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:54.570446 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-141293b3-b459-4b6e-9940-a9c7670d2f9b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:54.571211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-141293b3-b459-4b6e-9940-a9c7670d2f9b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:54.571666 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-141293b3-b459-4b6e-9940-a9c7670d2f9b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:54.701043 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-141293b3-b459-4b6e-9940-a9c7670d2f9b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:54.709221 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-141293b3-b459-4b6e-9940-a9c7670d2f9b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1681 microversion: 2.1 time: 0.151014 Jul 28 18:14:54.709788 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 609/1233] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:54 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:55.187430 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-5569dac7-a558-4082-ac44-ca7e62cca674 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:55.188042 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-5569dac7-a558-4082-ac44-ca7e62cca674 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:55.196053 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5569dac7-a558-4082-ac44-ca7e62cca674 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.196491 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5569dac7-a558-4082-ac44-ca7e62cca674 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.197272 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5569dac7-a558-4082-ac44-ca7e62cca674 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.197723 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-5569dac7-a558-4082-ac44-ca7e62cca674 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.331118 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-5569dac7-a558-4082-ac44-ca7e62cca674 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:55.338609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-5569dac7-a558-4082-ac44-ca7e62cca674 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1469 microversion: 2.1 time: 0.155396 Jul 28 18:14:55.339169 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 625/1234] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:55 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:55.730822 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-2f890caf-00e9-4fd8-8bad-0e581c1f9026 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:55.731813 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-2f890caf-00e9-4fd8-8bad-0e581c1f9026 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:55.739650 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2f890caf-00e9-4fd8-8bad-0e581c1f9026 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.740217 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2f890caf-00e9-4fd8-8bad-0e581c1f9026 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.740856 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2f890caf-00e9-4fd8-8bad-0e581c1f9026 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:55.741286 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-2f890caf-00e9-4fd8-8bad-0e581c1f9026 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:55.897493 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-2f890caf-00e9-4fd8-8bad-0e581c1f9026 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:55.904984 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-2f890caf-00e9-4fd8-8bad-0e581c1f9026 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1681 microversion: 2.1 time: 0.177796 Jul 28 18:14:55.911619 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 610/1235] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:55 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:56.361600 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-3a9f5fc7-053b-4c08-a8aa-5895feb0fbf4 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:56.362483 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-3a9f5fc7-053b-4c08-a8aa-5895feb0fbf4 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:56.370746 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3a9f5fc7-053b-4c08-a8aa-5895feb0fbf4 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.371188 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3a9f5fc7-053b-4c08-a8aa-5895feb0fbf4 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:56.372022 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3a9f5fc7-053b-4c08-a8aa-5895feb0fbf4 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.372924 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-3a9f5fc7-053b-4c08-a8aa-5895feb0fbf4 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:56.780676 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-3a9f5fc7-053b-4c08-a8aa-5895feb0fbf4 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:56.789314 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-3a9f5fc7-053b-4c08-a8aa-5895feb0fbf4 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1469 microversion: 2.1 time: 0.433014 Jul 28 18:14:56.789969 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 626/1236] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:56 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:56.902788 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-7e3fc06c-53bf-44b2-ab13-9df7c075563a req-e60409d7-2f62-4be0-9acd-0c9a45afd335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2145474e-af1c-4805-8d6f-54a7b8c56eba", "name": "network-vif-deleted", "tag": "4b7c2b04-d1dc-438f-9eee-c7d25b553ac4"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:56.908878 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-7e3fc06c-53bf-44b2-ab13-9df7c075563a req-e60409d7-2f62-4be0-9acd-0c9a45afd335 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.909210 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-7e3fc06c-53bf-44b2-ab13-9df7c075563a req-e60409d7-2f62-4be0-9acd-0c9a45afd335 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:56.921448 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-7e3fc06c-53bf-44b2-ab13-9df7c075563a req-e60409d7-2f62-4be0-9acd-0c9a45afd335 service nova] Creating event network-vif-deleted:4b7c2b04-d1dc-438f-9eee-c7d25b553ac4 for instance 2145474e-af1c-4805-8d6f-54a7b8c56eba on hv-cinder-83754 Jul 28 18:14:56.927141 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-7e3fc06c-53bf-44b2-ab13-9df7c075563a req-e60409d7-2f62-4be0-9acd-0c9a45afd335 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032791 Jul 28 18:14:56.931446 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-fc52d4f0-f5e7-46a3-aa1b-c724a429b8f9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:56.931446 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-fc52d4f0-f5e7-46a3-aa1b-c724a429b8f9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:56.932125 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 611/1237] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:56.936402 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fc52d4f0-f5e7-46a3-aa1b-c724a429b8f9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.936932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fc52d4f0-f5e7-46a3-aa1b-c724a429b8f9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:56.937803 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fc52d4f0-f5e7-46a3-aa1b-c724a429b8f9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:56.939180 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-fc52d4f0-f5e7-46a3-aa1b-c724a429b8f9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:57.034949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-fc52d4f0-f5e7-46a3-aa1b-c724a429b8f9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:57.042400 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-fc52d4f0-f5e7-46a3-aa1b-c724a429b8f9 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1614 microversion: 2.1 time: 0.118799 Jul 28 18:14:57.042961 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 627/1238] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:56 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1614 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:57.810962 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:57.811609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:57.829310 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:57.829872 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:57.830917 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:57.831354 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:57.874343 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:57.875151 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:57.876280 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.objects.instance [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lazy-loading 'fault' on Instance uuid 2145474e-af1c-4805-8d6f-54a7b8c56eba {{(pid=130401) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:14:57.919625 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.policy [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965acd6b6b44472ebf6511f4cbb54b45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d8a4598dd0741fabc1b38917626e133', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130401) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:57.927867 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-7d889c16-33b7-4f32-b92b-38b6bac1e7d9 tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 200 len: 1304 microversion: 2.1 time: 0.121220 Jul 28 18:14:57.932222 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 612/1239] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:57 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:58.065509 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:58.066113 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:58.072473 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:58.073026 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:58.073687 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:58.074111 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:58.108088 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:58.108619 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:58.109024 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.objects.instance [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lazy-loading 'fault' on Instance uuid a98bdea7-b9a4-48fa-a509-a9abfff41796 {{(pid=130400) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 18:14:58.155711 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.policy [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de20d8b31db44abf91a482d81b898755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8daf9e3c7be417c82e7cbf8624d1d5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130400) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 18:14:58.163368 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-922ef895-cb1c-420d-b8d3-075564202969 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 200 len: 1331 microversion: 2.1 time: 0.102301 Jul 28 18:14:58.163950 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 628/1240] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:58 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 18:14:58.941518 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [req-6edc1906-ac10-45b1-bb96-8ad436003678 req-96685f94-e1ec-4130-a884-d4ff5e11a986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98bdea7-b9a4-48fa-a509-a9abfff41796", "name": "network-vif-deleted", "tag": "9e90b8d5-026a-4772-9455-d60901486ae8"}]} {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 18:14:58.948914 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:58.949524 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] [instance: 2145474e-af1c-4805-8d6f-54a7b8c56eba] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:58.951299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-6edc1906-ac10-45b1-bb96-8ad436003678 req-96685f94-e1ec-4130-a884-d4ff5e11a986 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:58.951736 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [req-6edc1906-ac10-45b1-bb96-8ad436003678 req-96685f94-e1ec-4130-a884-d4ff5e11a986 service nova] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:58.956322 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:58.956795 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:58.957549 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:58.957979 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:58.963534 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.compute.server_external_events [req-6edc1906-ac10-45b1-bb96-8ad436003678 req-96685f94-e1ec-4130-a884-d4ff5e11a986 service nova] Creating event network-vif-deleted:9e90b8d5-026a-4772-9455-d60901486ae8 for instance a98bdea7-b9a4-48fa-a509-a9abfff41796 on hv-cinder-83754 Jul 28 18:14:58.968764 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [req-6edc1906-ac10-45b1-bb96-8ad436003678 req-96685f94-e1ec-4130-a884-d4ff5e11a986 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030999 Jul 28 18:14:58.970152 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 613/1241] 10.222.0.85 () {64 vars in 1317 bytes} [Thu Jul 28 18:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 18:14:58.972423 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] HTTP exception thrown: Instance 2145474e-af1c-4805-8d6f-54a7b8c56eba could not be found. Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Request method failure captured: Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba HTTP/1.1 Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4tIL_DAykai5fRO1fi_MRVbsCLBcgdLQDGXUNtq7Cc8KPJ9Q7a5fJrbCFeCD2vxai-VS1WXtCH9uA8Yi_zLoNdFl4plNF3lj-ljUljov3X6mikqI1raz0tR5xZ0eTgD_O2eT4k_ImteN8RA2l6V6krKppNy_2N-gyI9dYu-LfOPe9iQ Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: 6d8a4598dd0741fabc1b38917626e133 Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-VolumesNegativeTest-497342886 Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:14:58.973953 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6d8a4598dd0741fabc1b38917626e133"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_6d8a4598dd0741fabc1b38917626e133", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/6d8a4598dd0741fabc1b38917626e133"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/6d8a4598dd0741fabc1b38917626e133"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-VolumesNegativeTest-497342886 Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: 6d8a4598dd0741fabc1b38917626e133 Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-VolumesNegativeTest-497342886 Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-VolumesNegativeTest-497342886-project Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: 965acd6b6b44472ebf6511f4cbb54b45 Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-VolumesNegativeTest-497342886-project Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 2145474e-af1c-4805-8d6f-54a7b8c56eba could not be found. Jul 28 18:14:58.975773 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '2145474e-af1c-4805-8d6f-54a7b8c56eba'} Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2145474e-af1c-4805-8d6f-54a7b8c56eba could not be found. Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:14:58.976817 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2145474e-af1c-4805-8d6f-54a7b8c56eba could not be found. Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2145474e-af1c-4805-8d6f-54a7b8c56eba could not be found. Jul 28 18:14:58.978537 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:14:58.980045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] Returning 404 to user: Instance 2145474e-af1c-4805-8d6f-54a7b8c56eba could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:14:58.980045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-ff9f3530-e7d1-480f-943c-9f78b2a8998e tempest-VolumesNegativeTest-497342886 tempest-VolumesNegativeTest-497342886-project] 10.222.0.85 "GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba" status: 404 len: 111 microversion: 2.1 time: 0.030293 Jul 28 18:14:58.980045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 629/1242] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:58 2022] GET /compute/v2.1/servers/2145474e-af1c-4805-8d6f-54a7b8c56eba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 18:14:59.185299 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:59.185994 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:14:59.192430 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:59.192876 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:59.193636 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:14:59.194089 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:14:59.207766 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 HTTP/1.1 Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:14:59.209404 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:14:59.211131 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'a98bdea7-b9a4-48fa-a509-a9abfff41796'} Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:14:59.212305 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:14:59.213870 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:14:59.215391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:14:59.215391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-de5ec59e-7a0a-4687-a8e5-4008541702de tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 404 len: 111 microversion: 2.1 time: 0.029818 Jul 28 18:14:59.215391 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 614/1243] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:14:59 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:14:59.220563 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-aebcc378-377d-46b6-800c-40d0b05f4830 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '.version_select at 0x7fdae03d8280>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:14:59.321101 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-aebcc378-377d-46b6-800c-40d0b05f4830 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664627698" status: 202 len: 0 microversion: 2.1 time: 0.104818 Jul 28 18:14:59.322206 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 630/1244] 10.222.0.85 () {58 vars in 1218 bytes} [Thu Jul 28 18:14:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664627698 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 18:15:01.421136 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:01.421679 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:01.429025 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:01.429498 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:01.430277 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:01.430759 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:01.445444 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 HTTP/1.1 Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:15:01.447081 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.448835 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'a98bdea7-b9a4-48fa-a509-a9abfff41796'} Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:01.450924 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.452609 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.454919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:01.454919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-1dd211b9-f650-49aa-8e61-6cbc6fa7857b tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 404 len: 111 microversion: 2.1 time: 0.031312 Jul 28 18:15:01.454919 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 615/1245] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:15:01 2022] DELETE /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:01.458171 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:01.459213 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: a98bdea7-b9a4-48fa-a509-a9abfff41796] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:01.466932 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:01.467380 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:01.468147 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:01.468815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:01.483303 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 HTTP/1.1 Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:15:01.485129 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.486949 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': 'a98bdea7-b9a4-48fa-a509-a9abfff41796'} Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:01.488018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. Jul 28 18:15:01.489609 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:01.491815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance a98bdea7-b9a4-48fa-a509-a9abfff41796 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:01.491815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-4a4a728c-e16e-404b-b7bc-cafd6e600ac0 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796" status: 404 len: 111 microversion: 2.1 time: 0.033425 Jul 28 18:15:01.491815 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 631/1246] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:01 2022] GET /compute/v2.1/servers/a98bdea7-b9a4-48fa-a509-a9abfff41796 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:02.863324 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:02.863826 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:02.871409 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.872508 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.873833 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.875074 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.890317 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b HTTP/1.1 Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:15:02.893832 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.898616 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b'} Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:02.899770 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.901553 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.904959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:02.904959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-0fb6f934-1ace-45d1-9b9a-ca1942b2b109 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 404 len: 111 microversion: 2.1 time: 0.034943 Jul 28 18:15:02.904959 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 616/1247] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:15:02 2022] DELETE /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:02.910138 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:02.910138 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:02.915295 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.920769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.920769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.920769 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.932132 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b HTTP/1.1 Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:15:02.933888 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.935655 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': 'e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b'} Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:02.936742 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. Jul 28 18:15:02.938677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.940102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:02.940102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-84c07283-a734-480f-b233-318c64cf23c1 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b" status: 404 len: 111 microversion: 2.1 time: 0.036722 Jul 28 18:15:02.940102 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 632/1248] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:02 2022] GET /compute/v2.1/servers/e65e3a05-60ea-4b39-a3e9-3a1e3fa1172b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:02.944162 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:02.944585 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:02.951028 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.955173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.955173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.955173 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.957797 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG dbcounter [-] [130401] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130401) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 18:15:02.967336 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 HTTP/1.1 Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:15:02.969517 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:02.971270 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': 'd49c8f7f-b382-4cbe-a1b0-3483b3d21273'} Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:02.972211 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:02.973568 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:02.975008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:02.975008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-28cc6671-62a4-42dc-be6c-64a21914b484 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 404 len: 111 microversion: 2.1 time: 0.030700 Jul 28 18:15:02.975008 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 617/1249] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:15:02 2022] DELETE /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:02.979556 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:02.980187 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: d49c8f7f-b382-4cbe-a1b0-3483b3d21273] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:02.986740 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.987446 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:02.988227 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:02.988664 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:03.003465 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 HTTP/1.1 Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:15:03.005018 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:03.006622 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': 'd49c8f7f-b382-4cbe-a1b0-3483b3d21273'} Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:03.010963 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. Jul 28 18:15:03.012496 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:03.015045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance d49c8f7f-b382-4cbe-a1b0-3483b3d21273 could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:03.015045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-8755237e-f14f-4156-88b4-f4985a8db82e tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273" status: 404 len: 111 microversion: 2.1 time: 0.030692 Jul 28 18:15:03.015045 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 633/1250] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:02 2022] GET /compute/v2.1/servers/d49c8f7f-b382-4cbe-a1b0-3483b3d21273 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:04.402052 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:04.402613 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.compute.api [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130401) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:04.411190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:04.411637 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:04.412465 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:04.412901 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG oslo_concurrency.lockutils [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130401) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:04.426722 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.wsgi [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: request: DELETE /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b HTTP/1.1 Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept: application/json Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Accept-Encoding: identity Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Connection: close Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Length: 0 Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Content-Type: application/json Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Host: 10.222.0.85 Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Openstack-System-Scope: None Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Id: None Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Domain-Name: None Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Identity-Status: Confirmed Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Is-Admin-Project: True Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Id: default Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Domain-Name: Default Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Role: reader,member Jul 28 18:15:04.428255 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Roles: reader,member Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Id: default Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Domain-Name: Default Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: method: > Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: exception: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.430142 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: action_args: {'id': '4f9e762e-5473-4949-8d19-ff0bfe5bb52b'} Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: {{(pid=130401) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:04.431436 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.433190 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.435009 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: DEBUG nova.api.openstack.wsgi [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. {{(pid=130401) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:04.435009 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO nova.api.openstack.requestlog [None req-9be3feb4-30e6-4f41-97d4-82adf8871c08 tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 404 len: 111 microversion: 2.1 time: 0.031505 Jul 28 18:15:04.435009 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: [pid: 130401|app: 0|req: 618/1251] 10.222.0.85 () {58 vars in 1239 bytes} [Thu Jul 28 18:15:04 2022] DELETE /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:15:04.438268 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Calling method '>' {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 18:15:04.438960 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.compute.api [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] [instance: 4f9e762e-5473-4949-8d19-ff0bfe5bb52b] Fetching instance by UUID {{(pid=130400) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 18:15:04.445439 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:04.445889 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:04.446682 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 18:15:04.447115 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG oslo_concurrency.lockutils [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Lock "34fd1832-dad1-4ec6-9afc-d537dee5a553" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130400) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 18:15:04.461050 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.wsgi [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] HTTP exception thrown: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Request method failure captured: Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: request: GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b HTTP/1.1 Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept: application/json Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Accept-Encoding: identity Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Connection: close Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Length: 0 Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Content-Type: application/json Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Host: 10.222.0.85 Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Openstack-System-Scope: None Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: User-Agent: python-urllib3/1.26.10 Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Auth-Token: gAAAAABi4tEJOHXpRqV-y3VKOel95QPvg0lL1FcOBsj5Y4XzL83FU8A5PHMxA_5k_BXBg_lyYLPr8DA0Qi5NWCZBYkz-xiF1xcFnDIeQGGN2QK8qT9DCu3cb3VNJVjKUzhHk2iilXEl-1GZiCHwqAR6G4PB9SAws1GHrbK5FbhShOfXoQpfjxeE Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Id: None Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Domain-Name: None Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Identity-Status: Confirmed Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Is-Admin-Project: True Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Id: default Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Domain-Name: Default Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Project-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Role: reader,member Jul 28 18:15:04.462610 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Roles: reader,member Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:8080/v1/AUTH_b8daf9e3c7be417c82e7cbf8624d1d5d", "adminURL": "http://10.222.0.85:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/b8daf9e3c7be417c82e7cbf8624d1d5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}] Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Id: b8daf9e3c7be417c82e7cbf8624d1d5d Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-645465470 Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Id: default Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Domain-Name: Default Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Id: de20d8b31db44abf91a482d81b898755 Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: X-User-Name: tempest-AttachVolumeNegativeTest-645465470-project Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: method: > Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: exception: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.464320 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: action_args: {'id': '4f9e762e-5473-4949-8d19-ff0bfe5bb52b'} Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: {{(pid=130400) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 18:15:04.465589 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. Jul 28 18:15:04.467661 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: ERROR nova.api.openstack.wsgi Jul 28 18:15:04.469840 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: DEBUG nova.api.openstack.wsgi [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] Returning 404 to user: Instance 4f9e762e-5473-4949-8d19-ff0bfe5bb52b could not be found. {{(pid=130400) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 18:15:04.469840 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO nova.api.openstack.requestlog [None req-1e1bfed2-6655-47ad-8620-a0b8e2c6000f tempest-AttachVolumeNegativeTest-645465470 tempest-AttachVolumeNegativeTest-645465470-project] 10.222.0.85 "GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b" status: 404 len: 111 microversion: 2.1 time: 0.029776 Jul 28 18:15:04.469840 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: [pid: 130400|app: 0|req: 634/1252] 10.222.0.85 () {58 vars in 1236 bytes} [Thu Jul 28 18:15:04 2022] GET /compute/v2.1/servers/4f9e762e-5473-4949-8d19-ff0bfe5bb52b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 18:16:48.658818 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:16:48.659523 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Thu Jul 28 18:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:17:05.621006 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:17:05.621717 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Thu Jul 28 18:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:17:05.696985 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:17:05.697485 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Thu Jul 28 18:17:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:17:08.194786 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:17:08.195439 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Thu Jul 28 18:17:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:17:19.861267 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:17:19.861720 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Thu Jul 28 18:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:17:23.108928 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:17:23.109500 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Thu Jul 28 18:17:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:20:08.667885 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:20:08.668539 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Thu Jul 28 18:20:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:20:25.629894 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:20:25.630647 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Thu Jul 28 18:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:20:25.706080 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:20:25.706728 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Thu Jul 28 18:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:20:28.204789 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:20:28.205550 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Thu Jul 28 18:20:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:20:39.869603 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:20:39.870109 dv-cinder-837543-7-iscsi devstack@n-api.service[130401]: Thu Jul 28 18:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 18:20:43.118099 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 18:20:43.118677 dv-cinder-837543-7-iscsi devstack@n-api.service[130400]: Thu Jul 28 18:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!